-- Logs begin at Thu 2022-06-30 17:14:44 UTC, end at Thu 2022-06-30 18:53:59 UTC. -- Jun 30 18:19:44.612545 dv-cinder-803785-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 30 18:19:44.620007 dv-cinder-803785-1-iscsi devstack@n-api.service[103220]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 30 18:19:44.626884 dv-cinder-803785-1-iscsi devstack@n-api.service[103220]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 30 18:19:44 2022] *** Jun 30 18:19:44.626884 dv-cinder-803785-1-iscsi devstack@n-api.service[103220]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 30 18:19:44.626884 dv-cinder-803785-1-iscsi devstack@n-api.service[103220]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 30 18:19:44.626884 dv-cinder-803785-1-iscsi devstack@n-api.service[103220]: nodename: dv-cinder-803785-1-iscsi Jun 30 18:19:44.626884 dv-cinder-803785-1-iscsi devstack@n-api.service[103220]: machine: x86_64 Jun 30 18:19:44.626884 dv-cinder-803785-1-iscsi devstack@n-api.service[103220]: clock source: unix Jun 30 18:19:44.626884 dv-cinder-803785-1-iscsi devstack@n-api.service[103220]: pcre jit disabled Jun 30 18:19:44.626884 dv-cinder-803785-1-iscsi devstack@n-api.service[103220]: detected number of CPU cores: 4 Jun 30 18:19:44.626884 dv-cinder-803785-1-iscsi devstack@n-api.service[103220]: current working directory: / Jun 30 18:19:44.626884 dv-cinder-803785-1-iscsi devstack@n-api.service[103220]: detected binary path: /usr/bin/uwsgi-core Jun 30 18:19:44.626884 dv-cinder-803785-1-iscsi devstack@n-api.service[103220]: your processes number limit is 47680 Jun 30 18:19:44.626884 dv-cinder-803785-1-iscsi devstack@n-api.service[103220]: your memory page size is 4096 bytes Jun 30 18:19:44.626884 dv-cinder-803785-1-iscsi devstack@n-api.service[103220]: detected max file descriptor number: 2048 Jun 30 18:19:44.626884 dv-cinder-803785-1-iscsi devstack@n-api.service[103220]: lock engine: pthread robust mutexes Jun 30 18:19:44.626884 dv-cinder-803785-1-iscsi devstack@n-api.service[103220]: thunder lock: enabled Jun 30 18:19:44.626884 dv-cinder-803785-1-iscsi devstack@n-api.service[103220]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 30 18:19:44.626884 dv-cinder-803785-1-iscsi devstack@n-api.service[103220]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 30 18:19:44.668472 dv-cinder-803785-1-iscsi devstack@n-api.service[103220]: Python main interpreter initialized at 0x5598c64ba9c0 Jun 30 18:19:44.668472 dv-cinder-803785-1-iscsi devstack@n-api.service[103220]: python threads support enabled Jun 30 18:19:44.668472 dv-cinder-803785-1-iscsi devstack@n-api.service[103220]: your server socket listen backlog is limited to 100 connections Jun 30 18:19:44.668472 dv-cinder-803785-1-iscsi devstack@n-api.service[103220]: your mercy for graceful operations on workers is 90 seconds Jun 30 18:19:44.668883 dv-cinder-803785-1-iscsi devstack@n-api.service[103220]: mapped 403077 bytes (393 KB) for 2 cores Jun 30 18:19:44.668883 dv-cinder-803785-1-iscsi devstack@n-api.service[103220]: *** Operational MODE: preforking *** Jun 30 18:19:44.669159 dv-cinder-803785-1-iscsi devstack@n-api.service[103220]: *** uWSGI is running in multiple interpreter mode *** Jun 30 18:19:44.669159 dv-cinder-803785-1-iscsi devstack@n-api.service[103220]: spawned uWSGI master process (pid: 103220) Jun 30 18:19:44.669373 dv-cinder-803785-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 30 18:19:44.671130 dv-cinder-803785-1-iscsi devstack@n-api.service[103220]: spawned uWSGI worker 1 (pid: 103221, cores: 1) Jun 30 18:19:44.673601 dv-cinder-803785-1-iscsi devstack@n-api.service[103220]: spawned uWSGI worker 2 (pid: 103222, cores: 1) Jun 30 18:19:44.673601 dv-cinder-803785-1-iscsi devstack@n-api.service[103220]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 30 18:19:45.345700 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 30 18:19:45.350854 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 30 18:19:46.491195 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 18:19:46.491195 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: from cryptography.utils import int_from_bytes Jun 30 18:19:46.491775 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 18:19:46.491775 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: from cryptography.utils import int_from_bytes Jun 30 18:19:46.493018 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 18:19:46.493018 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: from cryptography.utils import int_from_bytes Jun 30 18:19:46.493444 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 18:19:46.493444 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: from cryptography.utils import int_from_bytes Jun 30 18:19:49.003869 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 30 18:19:49.004556 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 30 18:19:49.004916 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 30 18:19:49.005014 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 30 18:19:49.005097 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 30 18:19:49.005177 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 30 18:19:49.005255 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 30 18:19:49.005359 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 30 18:19:49.005450 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 30 18:19:49.005530 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 30 18:19:49.005632 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.005856 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.005959 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.006130 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.006241 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.006451 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.006556 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.006769 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.006882 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.007094 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.007199 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.007405 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.007503 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.007723 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.007822 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.008041 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.008137 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.008297 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.008451 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.008599 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.008762 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.008921 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.009059 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-803785-1-iscsi {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.009227 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.009321 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-803785-1-iscsi {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.009526 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.009664 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.009858 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.009989 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.010172 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.010259 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.010469 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.010567 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.010779 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.010864 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.011078 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.011173 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.011398 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.011574 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.012788 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.012964 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.013111 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.013246 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.013372 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.013502 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.013661 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.014299 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.014444 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.014554 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.014685 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.014805 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.014939 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.015076 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.015211 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.015331 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.015461 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.015591 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.015724 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.015862 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.015994 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.016118 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-803785-1-iscsi {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.016329 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-803785-1-iscsi {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.016456 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.016587 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.016719 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.016843 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.016979 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.017104 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.017232 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.017373 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.017498 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.017664 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.017793 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.017925 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.018050 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.018199 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.018338 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.018505 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.018634 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.018817 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.018955 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.019128 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.019266 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.019442 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.019572 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.019757 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.019900 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.020040 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.020166 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.020345 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.020475 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.020650 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.020779 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.020958 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.021092 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.021257 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.021394 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.021558 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.021737 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.021860 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.021976 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.022122 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.022245 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.022426 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.022541 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.022745 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.022869 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.023062 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.023176 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.023309 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.023434 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.023545 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.023651 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.023856 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.023978 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.024170 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.024285 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.024473 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.024601 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.024777 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.024907 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.025081 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.025210 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.025380 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.025509 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.025706 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.025854 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.026011 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.026147 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.026312 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.026440 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.026615 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.026757 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.027415 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.027551 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.027678 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.027809 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.027943 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.028069 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.028069 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.028305 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.028437 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.028569 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.028569 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.028827 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.028827 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.029075 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.029199 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.029323 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.029323 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.030197 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.030325 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.030461 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.030594 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.030712 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.030836 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.031007 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.031144 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.031330 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.031461 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.031653 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.031783 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.031968 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.032098 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.032277 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.032407 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.032586 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.032724 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.032906 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.033035 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.033159 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.033296 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.033431 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.033557 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.033738 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.033874 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.034053 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.034205 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.034359 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.034489 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.034666 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.034795 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.034971 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.035109 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.035269 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.035769 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.035769 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.036047 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.036180 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.036180 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.036432 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.036557 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.036737 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.036864 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.037043 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.037271 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.037413 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.037639 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.037787 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.037956 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.038746 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.038898 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.039026 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.039026 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.039260 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.039383 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.039521 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.039647 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.039780 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.039911 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.040045 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.040177 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.040316 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.040447 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.040573 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.040711 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.040848 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.040972 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.041096 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.041300 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.041427 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.041550 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.041706 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.041833 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.041965 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.042099 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.042225 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.042349 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.042474 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.042597 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.042735 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.042873 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.043000 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.043124 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.043249 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.043372 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.043505 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.043631 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.043756 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.043887 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.044014 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.044191 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.044332 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.044505 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.044636 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.044812 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.044941 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.045152 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.045298 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.045457 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.045617 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.045788 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.045941 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.046089 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.046252 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.046382 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.046598 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.046741 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.046876 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.047011 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.047144 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.047274 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.047453 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.047583 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.047777 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.047915 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.048085 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.048223 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.048394 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.048523 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.048702 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.048840 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.049019 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.049149 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:19:49.049355 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.049490 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.049711 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.049844 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.050054 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.050183 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.050367 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.050495 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.050695 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.050826 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.051024 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.051162 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.051343 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.051472 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.051662 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.051824 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.051951 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.052075 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.052269 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.052410 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.052579 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.052707 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.052891 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.053028 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.053199 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.053340 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.053516 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.053712 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.053863 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.054023 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.054186 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.054317 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.054502 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.054634 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.054818 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.054955 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.055133 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.055273 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.055444 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.055572 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.055757 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.055886 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.056084 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.056254 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.056404 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.056534 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.056714 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.056844 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.057054 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.057200 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.057396 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.057527 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.057732 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.057865 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.058056 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.058188 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.058378 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.058509 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.058688 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.058825 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.058998 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.059130 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.059307 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.059436 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.059627 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.059756 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.059955 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.061235 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.061235 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.061450 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.061558 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.061707 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.061829 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.061944 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.062051 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.062221 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.062338 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.062537 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.062675 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.062854 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.062969 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.063168 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.063283 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.063508 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.063625 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.065922 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.066091 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.066091 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.066362 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.066574 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.066705 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.066830 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.066964 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.067100 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.067227 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.067361 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.067500 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.067627 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.067752 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.067883 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.068009 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.068145 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.068273 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.068405 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.068539 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.068664 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.068799 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.068929 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.069054 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.069179 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.069304 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.069428 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.069562 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.069708 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.069846 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.069980 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.070106 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.070239 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.070378 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.070511 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.070648 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.070774 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.070898 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.071021 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.071155 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.071290 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.071416 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.071540 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.071664 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.071797 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.071923 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.072055 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.072187 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.072321 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.072446 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.072580 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.072706 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.072830 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.072954 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.073079 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.073203 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.073342 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.073480 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.073631 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.073771 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.073912 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.074039 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.074172 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.074298 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.074423 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.074547 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.074671 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.074804 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.074931 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.075056 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.075192 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.075319 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.075444 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.075578 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.075710 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.075836 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.075960 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.076084 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.076213 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.076944 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.077086 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.077221 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.077471 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.077622 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.077750 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.077891 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.078026 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.078165 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.078292 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.078417 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.078555 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.078683 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.078808 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.078995 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.079127 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.079263 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.079399 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.079525 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.079650 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.079776 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.079889 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.080011 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.080149 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.080275 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.080399 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.080530 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.080657 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.080781 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.080915 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.081040 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.081165 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.081296 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.081434 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.081573 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.081719 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.081844 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.081968 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.082093 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.082230 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.082366 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.082503 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.082629 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.082763 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.082888 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.083076 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.083216 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.083395 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.083525 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.083718 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.083849 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.084032 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.084176 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.084346 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.084473 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.084655 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.084783 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.084966 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.085095 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.085275 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.085411 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.085629 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.085765 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.085909 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.086037 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.086223 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.086361 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.086542 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.086672 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.086851 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.086984 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.087170 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.087300 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.087481 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.087619 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.087798 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.087929 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.088101 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.088231 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.088416 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.088545 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.088732 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.088868 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.089066 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.089194 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.089379 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.089518 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.089723 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.089859 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.090036 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.090166 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.090346 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.090484 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.090652 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.090789 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.090960 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.091090 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.091269 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.091407 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.091577 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.091706 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.092432 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.092570 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.092836 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.093012 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.093185 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.093314 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.093450 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.093632 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.093762 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.093971 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.094098 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.094222 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.094336 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.094457 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.094589 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.094722 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.094893 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.095022 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.095221 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.095350 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.095551 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.095681 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.095861 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.096002 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.096172 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.096308 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.096492 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.096622 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.096798 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.096927 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.097106 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.097243 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.097414 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.097553 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.097741 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.097872 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.098047 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.098187 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.098354 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.098484 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.098665 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.098792 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.098973 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.099142 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.099283 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.099408 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.099572 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.099700 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.099876 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.100017 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.100179 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.100308 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.100482 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.100620 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.100782 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.100919 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.101087 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.101217 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.101398 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.101531 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.101719 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.101853 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.102037 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.102167 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.102357 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.102492 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.102657 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.102787 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.102966 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.103095 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.103268 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.103395 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.103579 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.103716 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.103882 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.104011 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.104184 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.104312 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.104483 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.104612 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.104787 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.104915 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.105117 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.105254 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.105421 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.105550 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.105757 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.105887 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.106075 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.106216 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.106383 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.106513 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.106691 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.106819 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.106998 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.107136 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.107305 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.107442 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.108156 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.108283 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.108472 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.108781 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.108911 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.109090 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.109228 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.109400 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.109539 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.109733 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.109876 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.110047 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.110179 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.110350 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.110488 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.110657 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.110785 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.110966 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.111096 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.111274 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.111417 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.111577 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.111714 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.111886 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.112017 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.112195 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.112336 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.112510 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.112764 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.112923 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.113102 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.113382 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.113514 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.113742 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.113881 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.114061 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.114191 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.114379 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.114503 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.114696 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.114825 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.115018 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.115149 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.115350 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.115481 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.115655 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.115803 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.115962 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.116093 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.116268 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.116410 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.116572 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.116703 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.116883 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.117013 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.117189 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.117327 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.117495 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.117667 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.117809 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.117944 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.118115 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.118254 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.118445 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.118580 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.118712 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.118839 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.118992 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.119130 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.119294 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.119426 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.119596 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.119733 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.119894 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.120036 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.120203 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.120341 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.120506 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.120636 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.120823 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.120961 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.121129 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.121257 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.121432 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.121563 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.121760 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.121902 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.122062 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.122201 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.122367 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.122496 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.122676 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.122815 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.123018 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.123193 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.123387 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.123518 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.123727 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.123863 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.124031 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.124162 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.124335 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.124466 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.124657 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.124790 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.124961 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.125091 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.125264 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.125403 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.125565 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.125762 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.125890 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.126015 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.126193 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.126324 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.126495 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.126627 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.126804 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.126935 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.127113 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.127253 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.127423 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.127554 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.127730 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.127861 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.128029 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.128169 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.128400 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.128545 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.128672 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.128804 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.128945 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.129084 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.129210 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.129335 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.129508 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.129667 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.129833 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.129974 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.130143 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.130273 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.130444 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.130572 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.130741 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.130882 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.131048 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.131178 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.131348 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.131477 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.131660 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.131790 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.131962 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.132101 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.132262 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.132393 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.132563 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.132695 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.132865 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.132993 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.133168 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.133304 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.133466 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.133637 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.133802 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.133932 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.134107 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.134248 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.134407 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.134541 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.134708 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.134846 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.135014 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.135153 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.135313 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.135451 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.135612 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.135742 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.135913 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.136050 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.136217 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.136349 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.136528 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.136656 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.136829 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.136969 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.137138 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.137270 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.137438 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.137567 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.137763 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.137895 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.138068 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.138197 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.138374 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.138579 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.138744 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.138929 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.139058 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.139193 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.139329 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.139479 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.139768 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.139899 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.140076 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.140205 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.140383 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.140505 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.140689 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.140827 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.140991 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.141119 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.141297 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.141436 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.141676 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.141822 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.141951 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.142075 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.142223 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.142367 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.142569 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.142700 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.142875 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.143005 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.143233 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.143372 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.143540 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.143682 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.143849 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.143977 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.144163 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.144301 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.144474 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.144601 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.144776 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.144904 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.145092 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.145223 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.145397 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.145530 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.145731 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.145859 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.146035 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.146167 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.146348 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.146481 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.146639 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.146775 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.146979 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.147108 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.147233 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.147357 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.147551 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.147680 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.147866 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.147997 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.148184 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.148313 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.148488 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.148696 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.148840 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.148967 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.149091 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.149216 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.149386 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.149526 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.149722 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.149851 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.150014 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.150145 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.150320 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.150458 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.150628 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.150757 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.150938 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.151067 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.151248 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.151386 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.151558 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.151686 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.151860 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.151990 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.152170 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.152310 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.152476 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.152606 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.152782 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.152910 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.153089 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.153219 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.153396 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.153525 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.153721 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.153850 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.154033 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.154166 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.154338 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.154965 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.155160 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.155299 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.155533 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.155669 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.155849 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.156051 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.156182 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.156369 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.156575 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.156707 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.156891 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.157021 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.157204 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.157344 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.157510 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.157667 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.157848 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.157990 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.158162 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.158302 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.158478 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.158608 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.158810 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.158939 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.159064 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.159198 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.159480 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.159611 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.159786 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.159914 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.160089 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.160228 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.160394 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.160532 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.160697 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.160826 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.161002 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.161132 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.161306 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.161442 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.161632 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.161766 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.161940 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.162072 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.162242 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.162369 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.162551 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.162686 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.162869 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.162998 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.163174 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.163304 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.163494 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.163624 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.163867 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.163997 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.164203 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.164340 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.164506 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.164646 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.164874 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.165003 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.165196 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.165332 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.165513 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.165702 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.165860 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.165989 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.166165 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.166296 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.166477 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.166644 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.166781 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.166915 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.167075 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.167212 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.167385 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.167515 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.167703 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.167845 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.168019 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.168157 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.168324 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.168454 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.168638 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.168795 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.168990 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.169120 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.169246 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.169371 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.169564 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.169719 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.169909 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.170147 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.170344 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.170506 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.170757 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.170890 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.171079 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.171218 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.171392 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.171522 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.171714 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.171847 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.172022 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.172150 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.172329 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.172471 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.172632 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.172762 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.172939 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.173071 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.173241 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.173378 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.173549 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.173703 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.173896 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.174027 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.174202 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.174345 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.174511 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.174640 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.174817 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.174947 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.175121 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.175262 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.175423 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.175552 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.175727 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.175856 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.176047 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.176186 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.176347 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.176475 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.176668 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.176797 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.176982 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.177120 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.177284 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.177412 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.177626 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.177762 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.177933 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.178063 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.178235 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.178365 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.178541 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.178678 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.178843 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.179089 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.179222 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.179347 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.179491 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.179617 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.179752 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.179887 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.180057 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.180187 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.180380 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.180519 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.180701 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.180831 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.181028 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.181156 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.181339 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.181479 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.181674 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.181806 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.181991 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.182121 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.182315 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.182459 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.182618 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.182748 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.182918 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.183048 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.183234 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.183373 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.183537 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.183666 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.183838 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.183966 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.184140 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.184280 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.184444 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.184572 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.184742 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.184871 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.185286 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.185421 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.186127 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.186265 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.186521 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.186675 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.186877 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.187011 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.187138 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.187264 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.187432 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.187614 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.187745 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.187871 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.188055 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.188185 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.188362 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.188506 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.188671 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.188809 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.188976 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.189106 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.189321 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.189461 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.189662 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.189794 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.189985 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.190116 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.190304 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.190447 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.190612 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.190746 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.190933 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.191065 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.191244 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.191374 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.191558 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.191686 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.191873 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.192003 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.192187 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.192316 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.192498 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.192634 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.192813 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.192945 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.193126 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.193272 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.193436 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.193633 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.193765 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.193889 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.194080 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.194212 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.194393 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.194523 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.194708 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.194917 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.195122 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.195250 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.195543 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.195674 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.195853 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.195992 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.196165 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.196306 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.196477 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.196607 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.196789 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.196931 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.197096 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.197225 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.197405 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.197549 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.197738 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.197880 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.198050 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.198190 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.198362 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.198490 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.198676 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.198807 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.198998 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.199141 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.199320 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.199450 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.199635 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.199766 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.199953 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.200083 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.200268 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.200412 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.200581 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.200718 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.200896 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.201025 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.201218 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.201420 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.201633 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.201817 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.201955 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.202090 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.202334 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.202469 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.202652 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.202783 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.202965 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.203103 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.203279 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.203419 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.203593 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.203721 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.203905 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.204035 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.204217 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.204350 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.204530 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.204666 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.204842 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.204980 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.205152 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.205281 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.205468 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.205620 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.205812 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.205960 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.206130 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.206251 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.206445 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.206576 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.206760 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.206899 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.207074 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.207204 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.207387 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.207592 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.207723 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.207906 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.208213 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.208343 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.208532 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.208672 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.208853 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.208983 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.209169 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.209299 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.209484 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.209645 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.209827 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.209957 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.210124 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.210253 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.210417 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.210555 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.210725 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.210857 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.211033 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.211165 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.211334 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.211465 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.211642 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.211773 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.211947 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.212084 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.212244 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.212383 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.212562 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.212692 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.212867 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.213024 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.213190 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.213394 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.213526 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.213774 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.214041 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.214171 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.214391 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.214534 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.214708 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.214837 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.215022 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.215150 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.215331 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.215462 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.215650 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.215777 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.215953 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.216081 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.216257 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.216388 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.216566 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.216693 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.217377 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.217513 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.217724 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.217912 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.218060 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.218229 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.218358 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.218546 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.218691 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.218858 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.218997 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.219163 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.219295 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.219474 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.219606 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.219777 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.219907 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.220079 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.220208 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.220397 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.220537 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.220700 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.220828 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.221001 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.221137 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.221302 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.221432 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.221621 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.221754 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.221929 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.222060 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.222235 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.222366 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.222535 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.222674 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.222837 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.222975 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.223137 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.223269 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.223444 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.223573 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.223744 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.223887 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.224044 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.224173 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.224357 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.224495 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.224665 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.224787 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.225013 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.225113 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.225335 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.225441 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.225666 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.225794 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.225971 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.226067 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.226280 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.226368 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.226593 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.226684 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.226913 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.227001 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.227225 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.227319 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.227536 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.227635 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.227876 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.227964 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.228190 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.228276 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.228526 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.228715 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.229048 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.229133 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.229371 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.229518 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.229723 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.229853 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.230045 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.230176 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.230348 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.230486 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.230654 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.230784 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.230954 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.231085 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.231263 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.231393 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.231575 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.231706 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.231884 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.232014 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.232194 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.232398 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.232576 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.233207 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.233425 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.233553 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.233769 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.233913 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.234085 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.234217 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.234399 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.234531 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.234716 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.234849 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.235027 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.235158 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.235341 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.235480 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.235653 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.235785 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.235961 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.236091 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.236271 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.236399 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.236588 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.236721 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.236913 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.237043 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.237231 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.237371 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.237547 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.237695 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.237891 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.238035 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.238201 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.238339 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.238511 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.238641 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.238820 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.238960 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.239127 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.239268 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.239432 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.239552 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.239749 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.239886 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.240064 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.240187 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.240368 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.240500 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.240671 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.240800 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.241084 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.241215 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.241395 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.241515 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.241738 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.241868 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.242049 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.242191 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.242359 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.242488 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.242678 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.242817 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.242987 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.243125 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.243302 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.243430 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.243609 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.243748 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.243921 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.244064 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.244250 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.244381 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.244575 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.244713 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.244895 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.245026 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.245197 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.245329 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.245501 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.245662 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.245826 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.245957 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.246132 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.246261 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.246442 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.246574 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.246745 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.246874 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.247044 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.247174 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.247342 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.247475 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.247640 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.247776 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.247937 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.248075 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.248286 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.248416 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.248594 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.248755 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.248884 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.249063 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.249194 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.249372 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.249512 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.249698 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.249830 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.250003 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.250142 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.250303 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.250433 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.250603 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.250734 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.250904 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.251042 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.251204 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.251335 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.251509 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.251633 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.251809 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.251940 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.252111 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.252239 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.252408 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.252545 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.252707 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.252835 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.253002 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.253138 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.253332 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.253476 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.253685 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.253818 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.254051 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.254188 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.254315 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.254450 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.254619 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.254749 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.254936 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.255067 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.255242 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.255379 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.255558 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.255695 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.255874 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.256002 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.256185 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.256315 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.256493 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.256622 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.256821 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.256950 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.257127 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.257264 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.257437 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.257566 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.257773 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.257903 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.258083 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.258221 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.258389 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.258526 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.258698 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.258836 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.259021 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.259157 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.259344 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.259476 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.259647 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.259780 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.259968 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.260105 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.260281 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.260414 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.260599 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.260743 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.260914 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.261045 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.261221 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.261350 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.261558 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.261712 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.261869 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.262002 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.262180 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.262310 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.262494 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.262624 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.262800 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.262929 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.263110 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.263248 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.263426 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.263559 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.263763 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.263917 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.264108 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.264237 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.264436 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.264567 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.264749 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.264880 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.265075 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.265216 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.265400 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.265530 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.265771 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.265911 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.266085 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.266217 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.266431 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.266561 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.266757 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.266887 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.267069 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.267206 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.267380 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.267509 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.267685 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.267813 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:19:49.267947 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 30 18:19:49.268074 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 30 18:19:49.421911 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: INFO dbcounter [None req-7544b3a4-523d-48c4-a898-0acdec68ec60 None None] Registered counter for database nova_api Jun 30 18:19:49.422594 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: INFO dbcounter [None req-bf99ab05-5856-4ea2-bad2-b8409f75df28 None None] Registered counter for database nova_api Jun 30 18:19:49.442990 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG oslo_db.sqlalchemy.engines [None req-7544b3a4-523d-48c4-a898-0acdec68ec60 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103222) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 18:19:49.446203 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG oslo_db.sqlalchemy.engines [None req-bf99ab05-5856-4ea2-bad2-b8409f75df28 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103221) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 18:19:49.449739 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG dbcounter [-] [103222] Writer thread running {{(pid=103222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 18:19:49.453554 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG dbcounter [-] [103221] Writer thread running {{(pid=103221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 18:19:49.509647 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.context [None req-bf99ab05-5856-4ea2-bad2-b8409f75df28 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c(cell1) {{(pid=103221) load_cells /opt/stack/nova/nova/context.py:464}} Jun 30 18:19:49.510951 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.context [None req-7544b3a4-523d-48c4-a898-0acdec68ec60 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c(cell1) {{(pid=103222) load_cells /opt/stack/nova/nova/context.py:464}} Jun 30 18:19:49.513512 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG oslo_concurrency.lockutils [None req-bf99ab05-5856-4ea2-bad2-b8409f75df28 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:19:49.515519 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG oslo_concurrency.lockutils [None req-7544b3a4-523d-48c4-a898-0acdec68ec60 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:19:49.515883 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG oslo_concurrency.lockutils [None req-bf99ab05-5856-4ea2-bad2-b8409f75df28 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:19:49.516672 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG oslo_concurrency.lockutils [None req-bf99ab05-5856-4ea2-bad2-b8409f75df28 None None] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:19:49.517128 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG oslo_concurrency.lockutils [None req-7544b3a4-523d-48c4-a898-0acdec68ec60 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:19:49.517940 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG oslo_concurrency.lockutils [None req-7544b3a4-523d-48c4-a898-0acdec68ec60 None None] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:19:49.518660 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG oslo_concurrency.lockutils [None req-bf99ab05-5856-4ea2-bad2-b8409f75df28 None None] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:19:49.519898 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG oslo_concurrency.lockutils [None req-7544b3a4-523d-48c4-a898-0acdec68ec60 None None] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:19:49.520653 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: INFO dbcounter [None req-bf99ab05-5856-4ea2-bad2-b8409f75df28 None None] Registered counter for database nova_cell0 Jun 30 18:19:49.521905 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: INFO dbcounter [None req-7544b3a4-523d-48c4-a898-0acdec68ec60 None None] Registered counter for database nova_cell0 Jun 30 18:19:49.526208 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: INFO dbcounter [None req-bf99ab05-5856-4ea2-bad2-b8409f75df28 None None] Registered counter for database nova_cell1 Jun 30 18:19:49.527364 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: INFO dbcounter [None req-7544b3a4-523d-48c4-a898-0acdec68ec60 None None] Registered counter for database nova_cell1 Jun 30 18:19:49.534297 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG oslo_db.sqlalchemy.engines [None req-bf99ab05-5856-4ea2-bad2-b8409f75df28 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103221) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 18:19:49.535491 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG oslo_db.sqlalchemy.engines [None req-bf99ab05-5856-4ea2-bad2-b8409f75df28 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103221) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 18:19:49.537929 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG oslo_db.sqlalchemy.engines [None req-7544b3a4-523d-48c4-a898-0acdec68ec60 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103222) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 18:19:49.541732 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG oslo_db.sqlalchemy.engines [None req-7544b3a4-523d-48c4-a898-0acdec68ec60 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103222) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 18:19:49.543245 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG dbcounter [-] [103221] Writer thread running {{(pid=103221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 18:19:49.543592 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG dbcounter [-] [103221] Writer thread running {{(pid=103221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 18:19:49.544449 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG dbcounter [-] [103222] Writer thread running {{(pid=103222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 18:19:49.688195 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG dbcounter [-] [103222] Writer thread running {{(pid=103222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 18:19:49.689022 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: INFO dbcounter [None req-bf99ab05-5856-4ea2-bad2-b8409f75df28 None None] Registered counter for database nova_cell0 Jun 30 18:19:49.698029 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG oslo_db.sqlalchemy.engines [None req-bf99ab05-5856-4ea2-bad2-b8409f75df28 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103221) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 18:19:49.698877 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: INFO dbcounter [None req-7544b3a4-523d-48c4-a898-0acdec68ec60 None None] Registered counter for database nova_cell0 Jun 30 18:19:49.703299 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG dbcounter [-] [103221] Writer thread running {{(pid=103221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 18:19:49.708740 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG oslo_db.sqlalchemy.engines [None req-7544b3a4-523d-48c4-a898-0acdec68ec60 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103222) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 18:19:49.713461 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG dbcounter [-] [103222] Writer thread running {{(pid=103222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 18:19:50.046968 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: WARNING keystonemiddleware.auth_token [None req-7544b3a4-523d-48c4-a898-0acdec68ec60 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 18:19:50.048653 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: WARNING keystonemiddleware.auth_token [None req-bf99ab05-5856-4ea2-bad2-b8409f75df28 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 18:19:50.058548 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: WARNING keystonemiddleware.auth_token [None req-7544b3a4-523d-48c4-a898-0acdec68ec60 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 18:19:50.059819 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: WARNING keystonemiddleware.auth_token [None req-bf99ab05-5856-4ea2-bad2-b8409f75df28 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 18:19:50.404147 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: WARNING keystonemiddleware.auth_token [None req-7544b3a4-523d-48c4-a898-0acdec68ec60 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 18:19:50.406824 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: WARNING keystonemiddleware.auth_token [None req-bf99ab05-5856-4ea2-bad2-b8409f75df28 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 18:19:50.410295 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: WARNING keystonemiddleware.auth_token [None req-7544b3a4-523d-48c4-a898-0acdec68ec60 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 18:19:50.412717 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: WARNING keystonemiddleware.auth_token [None req-bf99ab05-5856-4ea2-bad2-b8409f75df28 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 18:19:50.415559 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5598c64ba9c0 pid: 103222 (default app) Jun 30 18:19:50.417632 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-7544b3a4-523d-48c4-a898-0acdec68ec60 None None] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:19:50.418031 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5598c64ba9c0 pid: 103221 (default app) Jun 30 18:19:50.418833 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-7544b3a4-523d-48c4-a898-0acdec68ec60 None None] 10.222.0.33 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001763 Jun 30 18:19:50.419252 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 788 bytes} [Thu Jun 30 18:19:50 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:21:07.283831 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-bf99ab05-5856-4ea2-bad2-b8409f75df28 None None] Calling method '>' {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:21:07.285896 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-bf99ab05-5856-4ea2-bad2-b8409f75df28 None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003338 Jun 30 18:21:07.286306 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 1/2] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 30 18:21:07 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:21:07.297919 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG dbcounter [-] [103222] Writing DB stats nova_api:SELECT=3 {{(pid=103222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:21:07.300029 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG dbcounter [-] [103222] Writing DB stats nova_cell0:SELECT=3 {{(pid=103222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:21:07.301203 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG dbcounter [-] [103222] Writing DB stats nova_cell1:SELECT=3 {{(pid=103222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:21:07.302250 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG dbcounter [-] [103222] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:21:07.743558 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-4c2cd597-9f51-4271-8534-8fc48fc76945 admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:21:07.774938 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-4c2cd597-9f51-4271-8534-8fc48fc76945 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.482303 Jun 30 18:21:07.775669 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 2/3] 10.222.0.33 () {60 vars in 1291 bytes} [Thu Jun 30 18:21:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:21:09.896289 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-bf99ab05-5856-4ea2-bad2-b8409f75df28 None None] Calling method '>' {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:21:09.897299 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-bf99ab05-5856-4ea2-bad2-b8409f75df28 None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jun 30 18:21:09.897715 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 2/4] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 30 18:21:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:21:09.963286 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-c03b0c67-cb56-4042-aef7-c9506cc6c777 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "vcpus": 1, "id": "c1", "swap": 0, "os-flavor-access:is_public": true, "name": "cirros256", "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:21:09.982003 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 18:21:09.982003 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: warnings.warn(msg) Jun 30 18:21:10.016018 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-c03b0c67-cb56-4042-aef7-c9506cc6c777 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.112077 Jun 30 18:21:10.016657 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 3/5] 10.222.0.33 () {64 vars in 1282 bytes} [Thu Jun 30 18:21:09 2022] POST /compute/v2.1/flavors => generated 407 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 18:21:10.031045 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG dbcounter [-] [103221] Writing DB stats nova_api:SELECT=3 {{(pid=103221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:21:10.032392 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG dbcounter [-] [103221] Writing DB stats nova_cell1:SELECT=3 {{(pid=103221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:21:10.033473 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG dbcounter [-] [103221] Writing DB stats nova_cell0:SELECT=3 {{(pid=103221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:21:10.034882 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG dbcounter [-] [103221] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:21:10.244454 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-d090c9ce-6c93-4731-82e5-06ab0f0827af admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:21:10.246801 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 18:21:10.246801 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: warnings.warn(msg) Jun 30 18:21:10.310865 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-d090c9ce-6c93-4731-82e5-06ab0f0827af admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.285402 Jun 30 18:21:10.323844 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 3/6] 10.222.0.33 () {64 vars in 1335 bytes} [Thu Jun 30 18:21:10 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:21:12.915465 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-c03b0c67-cb56-4042-aef7-c9506cc6c777 admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:21:12.916667 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-c03b0c67-cb56-4042-aef7-c9506cc6c777 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001739 Jun 30 18:21:12.917360 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 4/7] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 30 18:21:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:21:13.034997 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-0bb55b3d-e15c-4ba4-b8b3-83066cdab93b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "ram": 512, "name": "ds512M", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5}} {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:21:13.053344 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 18:21:13.053344 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: warnings.warn(msg) Jun 30 18:21:13.076844 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-0bb55b3d-e15c-4ba4-b8b3-83066cdab93b admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.153320 Jun 30 18:21:13.077739 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 4/8] 10.222.0.33 () {64 vars in 1282 bytes} [Thu Jun 30 18:21:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 18:21:13.089355 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-75ff0527-da3d-4bbb-8ebd-33f8d5aa772b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:21:13.090973 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 18:21:13.090973 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: warnings.warn(msg) Jun 30 18:21:13.123586 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-75ff0527-da3d-4bbb-8ebd-33f8d5aa772b admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037880 Jun 30 18:21:13.124338 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 5/9] 10.222.0.33 () {64 vars in 1335 bytes} [Thu Jun 30 18:21:13 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:21:15.276114 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-0bb55b3d-e15c-4ba4-b8b3-83066cdab93b admin admin] Calling method '>' {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:21:15.276114 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-0bb55b3d-e15c-4ba4-b8b3-83066cdab93b admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jun 30 18:21:15.276114 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 5/10] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 30 18:21:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:21:15.343005 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-6a42bd56-8bf6-4810-80ba-07365a3ccbb9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "name": "ds1G", "os-flavor-access:is_public": true, "disk": 10, "vcpus": 1, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0}} {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:21:15.366732 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-6a42bd56-8bf6-4810-80ba-07365a3ccbb9 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.083426 Jun 30 18:21:15.367603 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 6/11] 10.222.0.33 () {64 vars in 1282 bytes} [Thu Jun 30 18:21:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 18:21:15.379233 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-61e8c285-be20-4b1e-835d-39bf9836e461 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:21:15.402373 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-61e8c285-be20-4b1e-835d-39bf9836e461 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026921 Jun 30 18:21:15.409887 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 6/12] 10.222.0.33 () {64 vars in 1335 bytes} [Thu Jun 30 18:21:15 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:21:17.691793 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-6a42bd56-8bf6-4810-80ba-07365a3ccbb9 admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:21:17.693074 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-6a42bd56-8bf6-4810-80ba-07365a3ccbb9 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Jun 30 18:21:17.693682 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 7/13] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 30 18:21:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:21:17.756369 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-76594fae-156e-4ee1-86d2-bad4a8f6809a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d3", "name": "ds2G", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "swap": 0, "rxtx_factor": 1.0, "ram": 2048}} {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:21:17.774403 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-76594fae-156e-4ee1-86d2-bad4a8f6809a admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074800 Jun 30 18:21:17.774970 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 7/14] 10.222.0.33 () {64 vars in 1282 bytes} [Thu Jun 30 18:21:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 18:21:17.786814 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-ec035979-54c0-41e9-97e4-449aafa4ffe1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:21:17.810027 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-ec035979-54c0-41e9-97e4-449aafa4ffe1 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026809 Jun 30 18:21:17.810948 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 8/15] 10.222.0.33 () {64 vars in 1335 bytes} [Thu Jun 30 18:21:17 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:21:19.953940 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-76594fae-156e-4ee1-86d2-bad4a8f6809a admin admin] Calling method '>' {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:21:19.956059 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-76594fae-156e-4ee1-86d2-bad4a8f6809a admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002359 Jun 30 18:21:19.958425 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 8/16] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 30 18:21:19 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:21:20.032385 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-ffd8b3a4-2b1f-433d-859e-a9abf4747e35 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "ram": 4096, "vcpus": 4, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "id": "d4", "rxtx_factor": 1.0}} {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:21:20.053631 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-ffd8b3a4-2b1f-433d-859e-a9abf4747e35 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.089600 Jun 30 18:21:20.054572 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 9/17] 10.222.0.33 () {64 vars in 1282 bytes} [Thu Jun 30 18:21:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 30 18:21:20.066212 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-44406f99-a35b-43dd-8f37-a1342b8bd8d4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:21:20.091555 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-44406f99-a35b-43dd-8f37-a1342b8bd8d4 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028953 Jun 30 18:21:20.092594 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 9/18] 10.222.0.33 () {64 vars in 1335 bytes} [Thu Jun 30 18:21:20 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:21:22.215523 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-ffd8b3a4-2b1f-433d-859e-a9abf4747e35 admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:21:22.216538 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-ffd8b3a4-2b1f-433d-859e-a9abf4747e35 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Jun 30 18:21:22.216822 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 10/19] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 30 18:21:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:21:22.278249 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-fbfc8307-2a69-4d61-b226-69142d602178 admin admin] Calling method '>' {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:21:22.307169 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-fbfc8307-2a69-4d61-b226-69142d602178 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.083725 Jun 30 18:21:22.307830 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 10/20] 10.222.0.33 () {60 vars in 1291 bytes} [Thu Jun 30 18:21:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:21:24.422893 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-ffd8b3a4-2b1f-433d-859e-a9abf4747e35 admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:21:24.423929 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-ffd8b3a4-2b1f-433d-859e-a9abf4747e35 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jun 30 18:21:24.424332 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 11/21] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 30 18:21:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:21:24.493649 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-00828d46-ed9c-4323-896d-46cee03e8cbf admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "ram": 512, "id": "1", "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1}} {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:21:24.515391 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-00828d46-ed9c-4323-896d-46cee03e8cbf admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.084243 Jun 30 18:21:24.515955 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 11/22] 10.222.0.33 () {64 vars in 1282 bytes} [Thu Jun 30 18:21:24 2022] POST /compute/v2.1/flavors => generated 402 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 18:21:24.528958 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-e9c8ab21-f041-4b46-8a35-2d787dc4a326 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:21:24.555612 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-e9c8ab21-f041-4b46-8a35-2d787dc4a326 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030239 Jun 30 18:21:24.556533 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 12/23] 10.222.0.33 () {64 vars in 1332 bytes} [Thu Jun 30 18:21:24 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:21:26.959360 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-00828d46-ed9c-4323-896d-46cee03e8cbf admin admin] Calling method '>' {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:21:26.960364 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-00828d46-ed9c-4323-896d-46cee03e8cbf admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Jun 30 18:21:26.960775 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 12/24] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 30 18:21:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:21:27.021411 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-3672bc50-016e-4139-a670-bc037b05e804 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "os-flavor-access:is_public": true, "vcpus": 1, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "swap": 0, "rxtx_factor": 1.0, "id": "2"}} {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:21:27.046379 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-3672bc50-016e-4139-a670-bc037b05e804 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.079775 Jun 30 18:21:27.046909 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 13/25] 10.222.0.33 () {64 vars in 1282 bytes} [Thu Jun 30 18:21:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 18:21:27.059616 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-5bf3e5e4-eb84-4fd2-bd97-d6022c6347bd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:21:27.084716 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-5bf3e5e4-eb84-4fd2-bd97-d6022c6347bd admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028866 Jun 30 18:21:27.085476 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 13/26] 10.222.0.33 () {64 vars in 1332 bytes} [Thu Jun 30 18:21:27 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:21:29.307174 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-3672bc50-016e-4139-a670-bc037b05e804 admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:21:29.308500 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-3672bc50-016e-4139-a670-bc037b05e804 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001826 Jun 30 18:21:29.309071 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 14/27] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 30 18:21:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:21:29.381512 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-8ed8faa2-5464-49c0-beb1-9b9c39c8602b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 40, "name": "m1.medium", "id": "3", "vcpus": 2, "ram": 4096, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:21:29.400663 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-8ed8faa2-5464-49c0-beb1-9b9c39c8602b admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.085649 Jun 30 18:21:29.401424 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 14/28] 10.222.0.33 () {64 vars in 1282 bytes} [Thu Jun 30 18:21:29 2022] POST /compute/v2.1/flavors => generated 406 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 18:21:29.417553 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-7f57254f-bd47-45b5-9369-ebc5c4136805 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:21:29.445482 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-7f57254f-bd47-45b5-9369-ebc5c4136805 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032925 Jun 30 18:21:29.446093 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 15/29] 10.222.0.33 () {64 vars in 1332 bytes} [Thu Jun 30 18:21:29 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:21:31.542201 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-8ed8faa2-5464-49c0-beb1-9b9c39c8602b admin admin] Calling method '>' {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:21:31.543206 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-8ed8faa2-5464-49c0-beb1-9b9c39c8602b admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Jun 30 18:21:31.543602 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 15/30] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 30 18:21:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:21:31.602269 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-e476c8a9-f25f-4f53-b433-7bcd23111288 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "ram": 8192, "id": "4", "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0}} {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:21:31.620646 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-e476c8a9-f25f-4f53-b433-7bcd23111288 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.070594 Jun 30 18:21:31.621149 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 16/31] 10.222.0.33 () {64 vars in 1282 bytes} [Thu Jun 30 18:21:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 18:21:31.633637 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-81f92830-09fe-4abb-b541-bd0b61d051f0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:21:31.661000 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-81f92830-09fe-4abb-b541-bd0b61d051f0 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030483 Jun 30 18:21:31.661290 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 16/32] 10.222.0.33 () {64 vars in 1332 bytes} [Thu Jun 30 18:21:31 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:21:33.793168 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-e476c8a9-f25f-4f53-b433-7bcd23111288 admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:21:33.794214 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-e476c8a9-f25f-4f53-b433-7bcd23111288 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jun 30 18:21:33.794614 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 17/33] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 30 18:21:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:21:33.863343 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-b191f7c4-af9b-476e-b65f-b6023424de2e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "swap": 0, "name": "m1.xlarge", "id": "5", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "rxtx_factor": 1.0, "vcpus": 8}} {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:21:33.882508 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-b191f7c4-af9b-476e-b65f-b6023424de2e admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.080681 Jun 30 18:21:33.890301 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 17/34] 10.222.0.33 () {64 vars in 1282 bytes} [Thu Jun 30 18:21:33 2022] POST /compute/v2.1/flavors => generated 408 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 30 18:21:33.896307 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-086eb88b-175f-471c-86d7-3aa04149c014 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:21:33.920621 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-086eb88b-175f-471c-86d7-3aa04149c014 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028639 Jun 30 18:21:33.934023 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 18/35] 10.222.0.33 () {64 vars in 1332 bytes} [Thu Jun 30 18:21:33 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:21:58.429184 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-b191f7c4-af9b-476e-b65f-b6023424de2e admin admin] Calling method '>' {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:21:58.430222 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-b191f7c4-af9b-476e-b65f-b6023424de2e admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jun 30 18:21:58.430624 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 18/36] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 30 18:21:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:21:58.441280 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG dbcounter [-] [103222] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:21:58.491200 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-76128595-b61f-49c3-9f29-b401e3ca846f admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:21:58.508327 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-76128595-b61f-49c3-9f29-b401e3ca846f admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071831 Jun 30 18:21:58.508863 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 19/37] 10.222.0.33 () {60 vars in 1291 bytes} [Thu Jun 30 18:21:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:21:59.426768 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-b191f7c4-af9b-476e-b65f-b6023424de2e admin admin] Calling method '>' {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:21:59.427772 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-b191f7c4-af9b-476e-b65f-b6023424de2e admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jun 30 18:21:59.428175 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 19/38] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jun 30 18:21:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:21:59.619349 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-cce4bea8-189d-4c81-a642-91ef16dd3aa2 admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:21:59.626245 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.wsgi [None req-cce4bea8-189d-4c81-a642-91ef16dd3aa2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 30 18:21:59.629501 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-cce4bea8-189d-4c81-a642-91ef16dd3aa2 admin admin] Request method failure captured: Jun 30 18:21:59.629501 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 30 18:21:59.629501 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: Accept: application/json Jun 30 18:21:59.629501 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: Accept-Encoding: gzip, deflate Jun 30 18:21:59.629501 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: Connection: keep-alive Jun 30 18:21:59.629501 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: Content-Length: 0 Jun 30 18:21:59.629501 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: Host: 10.222.0.33 Jun 30 18:21:59.629501 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: Openstack-Api-Version: compute 2.90 Jun 30 18:21:59.629501 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: Openstack-System-Scope: None Jun 30 18:21:59.629501 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: User-Agent: python-novaclient Jun 30 18:21:59.629501 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-Auth-Token: gAAAAABivenHgCW57fuL2R-8cPI0ACuutahGDW7aBWVWDDKgl9cDDx9I0IZChsGfgpMig3Hbo2nPeXeKtP57T_qCAX36zyNFkwM4XwKP5u63PbLxbHBetca3nb4Cy8SXVo-H-aX3HhaRUB3uOaH3YCI4_Wahzdcaw3SizkIUbmZT3V-Sc97_uoY Jun 30 18:21:59.629501 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-Domain-Id: None Jun 30 18:21:59.629501 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-Domain-Name: None Jun 30 18:21:59.629501 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-Identity-Status: Confirmed Jun 30 18:21:59.629501 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-Is-Admin-Project: True Jun 30 18:21:59.629501 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 18:21:59.629501 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-Project-Domain-Id: default Jun 30 18:21:59.629501 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-Project-Domain-Name: Default Jun 30 18:21:59.629501 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-Project-Id: 6ed5e6c375de4a6186ba026da89db56b Jun 30 18:21:59.629501 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-Project-Name: admin Jun 30 18:21:59.629501 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-Role: admin,reader,member Jun 30 18:21:59.629501 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-Roles: admin,reader,member Jun 30 18:21:59.631260 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6ed5e6c375de4a6186ba026da89db56b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6ed5e6c375de4a6186ba026da89db56b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6ed5e6c375de4a6186ba026da89db56b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6ed5e6c375de4a6186ba026da89db56b"}]}] Jun 30 18:21:59.631260 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-Tenant: admin Jun 30 18:21:59.631260 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-Tenant-Id: 6ed5e6c375de4a6186ba026da89db56b Jun 30 18:21:59.631260 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-Tenant-Name: admin Jun 30 18:21:59.631260 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-User: admin Jun 30 18:21:59.631260 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-User-Domain-Id: default Jun 30 18:21:59.631260 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-User-Domain-Name: Default Jun 30 18:21:59.631260 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-User-Id: de745ad7f2ed48ffbb043529099e53f0 Jun 30 18:21:59.631260 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-User-Name: admin Jun 30 18:21:59.631260 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: method: > Jun 30 18:21:59.631260 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: exception: Flavor 42 could not be found. Jun 30 18:21:59.631260 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: action_args: {'id': '42'} Jun 30 18:21:59.631260 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:21:59.631260 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:21:59.632337 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 18:21:59.632337 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 18:21:59.632337 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 18:21:59.632337 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 18:21:59.632337 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 18:21:59.632337 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 18:21:59.632337 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 18:21:59.632337 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 18:21:59.632337 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 18:21:59.632337 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:21:59.632337 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 18:21:59.632337 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 18:21:59.632337 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 30 18:21:59.632337 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi Jun 30 18:21:59.632337 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:21:59.632337 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi Jun 30 18:21:59.632337 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:21:59.632337 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:21:59.632337 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:21:59.633762 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:21:59.633762 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:21:59.633762 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:21:59.633762 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:21:59.633762 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 18:21:59.633762 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:21:59.633762 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 30 18:21:59.633762 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi Jun 30 18:21:59.633762 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:21:59.633762 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi Jun 30 18:21:59.633762 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:21:59.633762 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:21:59.633762 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:21:59.633762 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:21:59.633762 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:21:59.633762 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 30 18:21:59.633762 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi Jun 30 18:21:59.633762 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-cce4bea8-189d-4c81-a642-91ef16dd3aa2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:21:59.635130 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-cce4bea8-189d-4c81-a642-91ef16dd3aa2 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.064028 Jun 30 18:21:59.635130 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 20/39] 10.222.0.33 () {60 vars in 1190 bytes} [Thu Jun 30 18:21:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 30 18:21:59.637962 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG dbcounter [-] [103221] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:21:59.642433 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-db8bedfa-d23c-4d1c-9f5b-f4b5b3ebcede admin admin] Calling method '>' {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:21:59.663640 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-db8bedfa-d23c-4d1c-9f5b-f4b5b3ebcede admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026587 Jun 30 18:21:59.664205 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 20/40] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Jun 30 18:21:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:21:59.674795 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-5fb163d8-8f37-4b7d-beed-1207e09fb895 admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:21:59.696798 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-5fb163d8-8f37-4b7d-beed-1207e09fb895 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025662 Jun 30 18:21:59.697347 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 21/41] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Jun 30 18:21:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:21:59.708927 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-f1519831-7553-465d-9b62-7d5bbdc7f350 admin admin] Calling method '>' {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:21:59.715472 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.wsgi [None req-f1519831-7553-465d-9b62-7d5bbdc7f350 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 30 18:21:59.719111 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-f1519831-7553-465d-9b62-7d5bbdc7f350 admin admin] Request method failure captured: Jun 30 18:21:59.719111 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 30 18:21:59.719111 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: Accept: application/json Jun 30 18:21:59.719111 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: Accept-Encoding: gzip, deflate Jun 30 18:21:59.719111 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: Connection: keep-alive Jun 30 18:21:59.719111 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: Content-Length: 0 Jun 30 18:21:59.719111 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: Host: 10.222.0.33 Jun 30 18:21:59.719111 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: Openstack-Api-Version: compute 2.90 Jun 30 18:21:59.719111 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: Openstack-System-Scope: None Jun 30 18:21:59.719111 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: User-Agent: python-novaclient Jun 30 18:21:59.719111 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-Auth-Token: gAAAAABivenHgCW57fuL2R-8cPI0ACuutahGDW7aBWVWDDKgl9cDDx9I0IZChsGfgpMig3Hbo2nPeXeKtP57T_qCAX36zyNFkwM4XwKP5u63PbLxbHBetca3nb4Cy8SXVo-H-aX3HhaRUB3uOaH3YCI4_Wahzdcaw3SizkIUbmZT3V-Sc97_uoY Jun 30 18:21:59.719111 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-Domain-Id: None Jun 30 18:21:59.719111 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-Domain-Name: None Jun 30 18:21:59.719111 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-Identity-Status: Confirmed Jun 30 18:21:59.719111 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-Is-Admin-Project: True Jun 30 18:21:59.719111 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 18:21:59.719111 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-Project-Domain-Id: default Jun 30 18:21:59.719111 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-Project-Domain-Name: Default Jun 30 18:21:59.719111 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-Project-Id: 6ed5e6c375de4a6186ba026da89db56b Jun 30 18:21:59.719111 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-Project-Name: admin Jun 30 18:21:59.719111 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-Role: admin,reader,member Jun 30 18:21:59.719111 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-Roles: admin,reader,member Jun 30 18:21:59.720512 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6ed5e6c375de4a6186ba026da89db56b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6ed5e6c375de4a6186ba026da89db56b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6ed5e6c375de4a6186ba026da89db56b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6ed5e6c375de4a6186ba026da89db56b"}]}] Jun 30 18:21:59.720512 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-Tenant: admin Jun 30 18:21:59.720512 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-Tenant-Id: 6ed5e6c375de4a6186ba026da89db56b Jun 30 18:21:59.720512 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-Tenant-Name: admin Jun 30 18:21:59.720512 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-User: admin Jun 30 18:21:59.720512 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-User-Domain-Id: default Jun 30 18:21:59.720512 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-User-Domain-Name: Default Jun 30 18:21:59.720512 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-User-Id: de745ad7f2ed48ffbb043529099e53f0 Jun 30 18:21:59.720512 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-User-Name: admin Jun 30 18:21:59.720512 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: method: > Jun 30 18:21:59.720512 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: exception: Flavor 42 could not be found. Jun 30 18:21:59.720512 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: action_args: {'id': '42'} Jun 30 18:21:59.720512 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:21:59.720512 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:21:59.721294 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 18:21:59.721294 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 18:21:59.721294 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 18:21:59.721294 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 18:21:59.721294 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 18:21:59.721294 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 18:21:59.721294 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 18:21:59.721294 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 18:21:59.721294 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 18:21:59.721294 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:21:59.721294 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 18:21:59.721294 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 18:21:59.721294 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 30 18:21:59.721294 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi Jun 30 18:21:59.721294 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:21:59.721294 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi Jun 30 18:21:59.721294 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:21:59.721294 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:21:59.721294 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:21:59.722708 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:21:59.722708 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:21:59.722708 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:21:59.722708 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:21:59.722708 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 18:21:59.722708 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:21:59.722708 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 30 18:21:59.722708 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi Jun 30 18:21:59.722708 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:21:59.722708 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi Jun 30 18:21:59.722708 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:21:59.722708 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:21:59.722708 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:21:59.722708 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:21:59.722708 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:21:59.722708 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 30 18:21:59.722708 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi Jun 30 18:21:59.722708 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-f1519831-7553-465d-9b62-7d5bbdc7f350 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:21:59.724108 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-f1519831-7553-465d-9b62-7d5bbdc7f350 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016161 Jun 30 18:21:59.724108 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 21/42] 10.222.0.33 () {60 vars in 1190 bytes} [Thu Jun 30 18:21:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 30 18:22:00.546329 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-5fb163d8-8f37-4b7d-beed-1207e09fb895 admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:22:00.547371 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-5fb163d8-8f37-4b7d-beed-1207e09fb895 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Jun 30 18:22:00.547771 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 22/43] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jun 30 18:22:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:22:00.743048 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-21fab4a3-ef58-43c7-b585-190233a3e558 admin admin] Calling method '>' {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:22:00.749428 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.wsgi [None req-21fab4a3-ef58-43c7-b585-190233a3e558 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 30 18:22:00.751065 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-21fab4a3-ef58-43c7-b585-190233a3e558 admin admin] Request method failure captured: Jun 30 18:22:00.751065 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 30 18:22:00.751065 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: Accept: application/json Jun 30 18:22:00.751065 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: Accept-Encoding: gzip, deflate Jun 30 18:22:00.751065 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: Connection: keep-alive Jun 30 18:22:00.751065 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: Content-Length: 0 Jun 30 18:22:00.751065 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: Host: 10.222.0.33 Jun 30 18:22:00.751065 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: Openstack-Api-Version: compute 2.90 Jun 30 18:22:00.751065 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: Openstack-System-Scope: None Jun 30 18:22:00.751065 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: User-Agent: python-novaclient Jun 30 18:22:00.751065 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-Auth-Token: gAAAAABivenICCOYUYbIfUtcTPxJYXirgpwyb9dkO3IwsIp0vgSNphy7ZuMXAWN1ttiNmOF7srRdWGxQ229yelmcrPWMUIDwhBbBhlsQDIOMvwCCAAM2qU3rFOoNJIk2za2KfGtW5C6eS0aNlQMsIjON-B-0FTE2oGF2rw1Pj8Ww0N7vwmULko4 Jun 30 18:22:00.751065 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-Domain-Id: None Jun 30 18:22:00.751065 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-Domain-Name: None Jun 30 18:22:00.751065 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-Identity-Status: Confirmed Jun 30 18:22:00.751065 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-Is-Admin-Project: True Jun 30 18:22:00.751065 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 18:22:00.751065 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-Project-Domain-Id: default Jun 30 18:22:00.751065 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-Project-Domain-Name: Default Jun 30 18:22:00.751065 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-Project-Id: 6ed5e6c375de4a6186ba026da89db56b Jun 30 18:22:00.751065 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-Project-Name: admin Jun 30 18:22:00.751065 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-Role: admin,reader,member Jun 30 18:22:00.751065 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-Roles: admin,reader,member Jun 30 18:22:00.752624 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6ed5e6c375de4a6186ba026da89db56b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6ed5e6c375de4a6186ba026da89db56b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6ed5e6c375de4a6186ba026da89db56b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6ed5e6c375de4a6186ba026da89db56b"}]}] Jun 30 18:22:00.752624 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-Tenant: admin Jun 30 18:22:00.752624 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-Tenant-Id: 6ed5e6c375de4a6186ba026da89db56b Jun 30 18:22:00.752624 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-Tenant-Name: admin Jun 30 18:22:00.752624 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-User: admin Jun 30 18:22:00.752624 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-User-Domain-Id: default Jun 30 18:22:00.752624 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-User-Domain-Name: Default Jun 30 18:22:00.752624 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-User-Id: de745ad7f2ed48ffbb043529099e53f0 Jun 30 18:22:00.752624 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-User-Name: admin Jun 30 18:22:00.752624 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: method: > Jun 30 18:22:00.752624 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: exception: Flavor 84 could not be found. Jun 30 18:22:00.752624 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: action_args: {'id': '84'} Jun 30 18:22:00.752624 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:22:00.752624 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:22:00.753469 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 18:22:00.753469 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 18:22:00.753469 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 18:22:00.753469 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 18:22:00.753469 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 18:22:00.753469 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 18:22:00.753469 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 18:22:00.753469 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 18:22:00.753469 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 18:22:00.753469 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:22:00.753469 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 18:22:00.753469 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 18:22:00.753469 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 30 18:22:00.753469 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi Jun 30 18:22:00.753469 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:22:00.753469 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi Jun 30 18:22:00.753469 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:22:00.753469 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:22:00.753469 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:22:00.754722 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:22:00.754722 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:22:00.754722 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:22:00.754722 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:22:00.754722 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 18:22:00.754722 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:22:00.754722 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 30 18:22:00.754722 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi Jun 30 18:22:00.754722 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:22:00.754722 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi Jun 30 18:22:00.754722 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:22:00.754722 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:22:00.754722 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:22:00.754722 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:22:00.754722 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:22:00.754722 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 30 18:22:00.754722 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi Jun 30 18:22:00.754722 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-21fab4a3-ef58-43c7-b585-190233a3e558 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:22:00.756011 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-21fab4a3-ef58-43c7-b585-190233a3e558 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.063647 Jun 30 18:22:00.756011 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 22/44] 10.222.0.33 () {60 vars in 1190 bytes} [Thu Jun 30 18:22:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 30 18:22:00.762121 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-b052ca3d-2b55-4826-9673-c13b545c797b admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:22:00.777740 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-b052ca3d-2b55-4826-9673-c13b545c797b admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019117 Jun 30 18:22:00.778272 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 23/45] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Jun 30 18:22:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:22:00.788458 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-af15efda-7efe-4411-b15d-0db794f5f8bc admin admin] Calling method '>' {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:22:00.802562 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-af15efda-7efe-4411-b15d-0db794f5f8bc admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017696 Jun 30 18:22:00.803089 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 23/46] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Jun 30 18:22:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:22:00.812709 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-56e16731-5ea4-4f57-896b-9e053bd13d5b admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:22:00.818398 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.wsgi [None req-56e16731-5ea4-4f57-896b-9e053bd13d5b admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 30 18:22:00.819887 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-56e16731-5ea4-4f57-896b-9e053bd13d5b admin admin] Request method failure captured: Jun 30 18:22:00.819887 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 30 18:22:00.819887 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: Accept: application/json Jun 30 18:22:00.819887 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: Accept-Encoding: gzip, deflate Jun 30 18:22:00.819887 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: Connection: keep-alive Jun 30 18:22:00.819887 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: Content-Length: 0 Jun 30 18:22:00.819887 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: Host: 10.222.0.33 Jun 30 18:22:00.819887 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: Openstack-Api-Version: compute 2.90 Jun 30 18:22:00.819887 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: Openstack-System-Scope: None Jun 30 18:22:00.819887 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: User-Agent: python-novaclient Jun 30 18:22:00.819887 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-Auth-Token: gAAAAABivenICCOYUYbIfUtcTPxJYXirgpwyb9dkO3IwsIp0vgSNphy7ZuMXAWN1ttiNmOF7srRdWGxQ229yelmcrPWMUIDwhBbBhlsQDIOMvwCCAAM2qU3rFOoNJIk2za2KfGtW5C6eS0aNlQMsIjON-B-0FTE2oGF2rw1Pj8Ww0N7vwmULko4 Jun 30 18:22:00.819887 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-Domain-Id: None Jun 30 18:22:00.819887 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-Domain-Name: None Jun 30 18:22:00.819887 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-Identity-Status: Confirmed Jun 30 18:22:00.819887 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-Is-Admin-Project: True Jun 30 18:22:00.819887 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 18:22:00.819887 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-Project-Domain-Id: default Jun 30 18:22:00.819887 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-Project-Domain-Name: Default Jun 30 18:22:00.819887 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-Project-Id: 6ed5e6c375de4a6186ba026da89db56b Jun 30 18:22:00.819887 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-Project-Name: admin Jun 30 18:22:00.819887 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-Role: admin,reader,member Jun 30 18:22:00.819887 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-Roles: admin,reader,member Jun 30 18:22:00.821383 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6ed5e6c375de4a6186ba026da89db56b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6ed5e6c375de4a6186ba026da89db56b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6ed5e6c375de4a6186ba026da89db56b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6ed5e6c375de4a6186ba026da89db56b"}]}] Jun 30 18:22:00.821383 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-Tenant: admin Jun 30 18:22:00.821383 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-Tenant-Id: 6ed5e6c375de4a6186ba026da89db56b Jun 30 18:22:00.821383 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-Tenant-Name: admin Jun 30 18:22:00.821383 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-User: admin Jun 30 18:22:00.821383 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-User-Domain-Id: default Jun 30 18:22:00.821383 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-User-Domain-Name: Default Jun 30 18:22:00.821383 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-User-Id: de745ad7f2ed48ffbb043529099e53f0 Jun 30 18:22:00.821383 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-User-Name: admin Jun 30 18:22:00.821383 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: method: > Jun 30 18:22:00.821383 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: exception: Flavor 84 could not be found. Jun 30 18:22:00.821383 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: action_args: {'id': '84'} Jun 30 18:22:00.821383 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:22:00.821383 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:22:00.824462 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 18:22:00.824462 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 18:22:00.824462 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 18:22:00.824462 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 18:22:00.824462 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 18:22:00.824462 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 18:22:00.824462 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 18:22:00.824462 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 18:22:00.824462 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 18:22:00.824462 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:22:00.824462 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 18:22:00.824462 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 18:22:00.824462 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 30 18:22:00.824462 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi Jun 30 18:22:00.824462 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:22:00.824462 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi Jun 30 18:22:00.824462 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:22:00.824462 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:22:00.824462 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:22:00.825804 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:22:00.825804 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:22:00.825804 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:22:00.825804 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:22:00.825804 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 18:22:00.825804 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:22:00.825804 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 30 18:22:00.825804 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi Jun 30 18:22:00.825804 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:22:00.825804 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi Jun 30 18:22:00.825804 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:22:00.825804 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:22:00.825804 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:22:00.825804 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:22:00.825804 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:22:00.825804 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 30 18:22:00.825804 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi Jun 30 18:22:00.825804 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-56e16731-5ea4-4f57-896b-9e053bd13d5b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:22:00.828484 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-56e16731-5ea4-4f57-896b-9e053bd13d5b admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012604 Jun 30 18:22:00.828484 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 24/47] 10.222.0.33 () {60 vars in 1190 bytes} [Thu Jun 30 18:22:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 30 18:22:01.652576 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-af15efda-7efe-4411-b15d-0db794f5f8bc admin admin] Calling method '>' {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:22:01.653681 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-af15efda-7efe-4411-b15d-0db794f5f8bc admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001572 Jun 30 18:22:01.654212 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 24/48] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jun 30 18:22:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:22:01.852686 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-d22c7c4d-9a5d-4a60-a278-232f698897bb admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:22:01.859113 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.wsgi [None req-d22c7c4d-9a5d-4a60-a278-232f698897bb admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 30 18:22:01.860588 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-d22c7c4d-9a5d-4a60-a278-232f698897bb admin admin] Request method failure captured: Jun 30 18:22:01.860588 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 30 18:22:01.860588 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: Accept: application/json Jun 30 18:22:01.860588 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: Accept-Encoding: gzip, deflate Jun 30 18:22:01.860588 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: Connection: keep-alive Jun 30 18:22:01.860588 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: Content-Length: 0 Jun 30 18:22:01.860588 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: Host: 10.222.0.33 Jun 30 18:22:01.860588 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: Openstack-Api-Version: compute 2.90 Jun 30 18:22:01.860588 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: Openstack-System-Scope: None Jun 30 18:22:01.860588 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: User-Agent: python-novaclient Jun 30 18:22:01.860588 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-Auth-Token: gAAAAABivenJUogMoQ1ptriJVqVm0fKCS55i8QfI7IA5eNfydlOm29tEY_UKJGao68i8-GUXtVUQDecmpLcx_FdxJnkKHno_iIRpI4I9GiS4MRidrQ9N4X7khade1n9yn0wIZEpMqZX4neaK7tBPvv9d-bymbIn8H51Ss3qYTYPOCQgOvJ0OC_I Jun 30 18:22:01.860588 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-Domain-Id: None Jun 30 18:22:01.860588 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-Domain-Name: None Jun 30 18:22:01.860588 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-Identity-Status: Confirmed Jun 30 18:22:01.860588 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-Is-Admin-Project: True Jun 30 18:22:01.860588 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 18:22:01.860588 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-Project-Domain-Id: default Jun 30 18:22:01.860588 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-Project-Domain-Name: Default Jun 30 18:22:01.860588 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-Project-Id: 6ed5e6c375de4a6186ba026da89db56b Jun 30 18:22:01.860588 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-Project-Name: admin Jun 30 18:22:01.860588 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-Role: admin,reader,member Jun 30 18:22:01.860588 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-Roles: admin,reader,member Jun 30 18:22:01.862153 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6ed5e6c375de4a6186ba026da89db56b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6ed5e6c375de4a6186ba026da89db56b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6ed5e6c375de4a6186ba026da89db56b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6ed5e6c375de4a6186ba026da89db56b"}]}] Jun 30 18:22:01.862153 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-Tenant: admin Jun 30 18:22:01.862153 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-Tenant-Id: 6ed5e6c375de4a6186ba026da89db56b Jun 30 18:22:01.862153 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-Tenant-Name: admin Jun 30 18:22:01.862153 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-User: admin Jun 30 18:22:01.862153 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-User-Domain-Id: default Jun 30 18:22:01.862153 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-User-Domain-Name: Default Jun 30 18:22:01.862153 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-User-Id: de745ad7f2ed48ffbb043529099e53f0 Jun 30 18:22:01.862153 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: X-User-Name: admin Jun 30 18:22:01.862153 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: method: > Jun 30 18:22:01.862153 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: exception: Flavor 451 could not be found. Jun 30 18:22:01.862153 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: action_args: {'id': '451'} Jun 30 18:22:01.862153 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:22:01.862153 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:22:01.863096 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 18:22:01.863096 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 18:22:01.863096 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 18:22:01.863096 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 18:22:01.863096 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 18:22:01.863096 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 18:22:01.863096 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 18:22:01.863096 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 18:22:01.863096 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 18:22:01.863096 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:22:01.863096 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 18:22:01.863096 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 18:22:01.863096 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 30 18:22:01.863096 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi Jun 30 18:22:01.863096 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:22:01.863096 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi Jun 30 18:22:01.863096 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:22:01.863096 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:22:01.863096 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:22:01.864407 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:22:01.864407 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:22:01.864407 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:22:01.864407 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:22:01.864407 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 18:22:01.864407 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:22:01.864407 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 30 18:22:01.864407 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi Jun 30 18:22:01.864407 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:22:01.864407 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi Jun 30 18:22:01.864407 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:22:01.864407 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:22:01.864407 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:22:01.864407 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:22:01.864407 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:22:01.864407 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 30 18:22:01.864407 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: ERROR nova.api.openstack.wsgi Jun 30 18:22:01.864407 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-d22c7c4d-9a5d-4a60-a278-232f698897bb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:22:01.865708 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-d22c7c4d-9a5d-4a60-a278-232f698897bb admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.062434 Jun 30 18:22:01.865708 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 25/49] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Jun 30 18:22:01 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 30 18:22:01.871488 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-47116895-a2c2-4fa9-9e77-fed4f3563e6b admin admin] Calling method '>' {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:22:01.886387 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-47116895-a2c2-4fa9-9e77-fed4f3563e6b admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018370 Jun 30 18:22:01.886925 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 25/50] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Jun 30 18:22:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:22:01.896783 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-2e144438-0da9-494e-80e6-bf566533e756 admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:22:01.910681 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-2e144438-0da9-494e-80e6-bf566533e756 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017777 Jun 30 18:22:01.911199 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 26/51] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Jun 30 18:22:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:22:01.921261 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-cde8a109-49ea-45ff-9c68-0db282d6b0c8 admin admin] Calling method '>' {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:22:01.926704 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.wsgi [None req-cde8a109-49ea-45ff-9c68-0db282d6b0c8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 30 18:22:01.928190 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-cde8a109-49ea-45ff-9c68-0db282d6b0c8 admin admin] Request method failure captured: Jun 30 18:22:01.928190 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 30 18:22:01.928190 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: Accept: application/json Jun 30 18:22:01.928190 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: Accept-Encoding: gzip, deflate Jun 30 18:22:01.928190 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: Connection: keep-alive Jun 30 18:22:01.928190 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: Content-Length: 0 Jun 30 18:22:01.928190 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: Host: 10.222.0.33 Jun 30 18:22:01.928190 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: Openstack-Api-Version: compute 2.90 Jun 30 18:22:01.928190 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: Openstack-System-Scope: None Jun 30 18:22:01.928190 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: User-Agent: python-novaclient Jun 30 18:22:01.928190 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-Auth-Token: gAAAAABivenJUogMoQ1ptriJVqVm0fKCS55i8QfI7IA5eNfydlOm29tEY_UKJGao68i8-GUXtVUQDecmpLcx_FdxJnkKHno_iIRpI4I9GiS4MRidrQ9N4X7khade1n9yn0wIZEpMqZX4neaK7tBPvv9d-bymbIn8H51Ss3qYTYPOCQgOvJ0OC_I Jun 30 18:22:01.928190 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-Domain-Id: None Jun 30 18:22:01.928190 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-Domain-Name: None Jun 30 18:22:01.928190 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-Identity-Status: Confirmed Jun 30 18:22:01.928190 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-Is-Admin-Project: True Jun 30 18:22:01.928190 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 18:22:01.928190 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-Project-Domain-Id: default Jun 30 18:22:01.928190 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-Project-Domain-Name: Default Jun 30 18:22:01.928190 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-Project-Id: 6ed5e6c375de4a6186ba026da89db56b Jun 30 18:22:01.928190 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-Project-Name: admin Jun 30 18:22:01.928190 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-Role: admin,reader,member Jun 30 18:22:01.928190 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-Roles: admin,reader,member Jun 30 18:22:01.929754 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6ed5e6c375de4a6186ba026da89db56b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6ed5e6c375de4a6186ba026da89db56b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6ed5e6c375de4a6186ba026da89db56b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6ed5e6c375de4a6186ba026da89db56b"}]}] Jun 30 18:22:01.929754 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-Tenant: admin Jun 30 18:22:01.929754 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-Tenant-Id: 6ed5e6c375de4a6186ba026da89db56b Jun 30 18:22:01.929754 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-Tenant-Name: admin Jun 30 18:22:01.929754 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-User: admin Jun 30 18:22:01.929754 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-User-Domain-Id: default Jun 30 18:22:01.929754 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-User-Domain-Name: Default Jun 30 18:22:01.929754 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-User-Id: de745ad7f2ed48ffbb043529099e53f0 Jun 30 18:22:01.929754 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: X-User-Name: admin Jun 30 18:22:01.929754 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: method: > Jun 30 18:22:01.929754 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: exception: Flavor 451 could not be found. Jun 30 18:22:01.929754 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: action_args: {'id': '451'} Jun 30 18:22:01.929754 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:22:01.929754 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:22:01.930706 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 18:22:01.930706 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 18:22:01.930706 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 18:22:01.930706 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 18:22:01.930706 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 18:22:01.930706 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 18:22:01.930706 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 18:22:01.930706 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 18:22:01.930706 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 18:22:01.930706 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:22:01.930706 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 18:22:01.930706 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 18:22:01.930706 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 30 18:22:01.930706 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi Jun 30 18:22:01.930706 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:22:01.930706 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi Jun 30 18:22:01.930706 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:22:01.930706 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:22:01.930706 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:22:01.932258 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:22:01.932258 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:22:01.932258 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:22:01.932258 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:22:01.932258 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 18:22:01.932258 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:22:01.932258 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 30 18:22:01.932258 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi Jun 30 18:22:01.932258 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:22:01.932258 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi Jun 30 18:22:01.932258 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:22:01.932258 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:22:01.932258 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:22:01.932258 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:22:01.932258 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:22:01.932258 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 30 18:22:01.932258 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: ERROR nova.api.openstack.wsgi Jun 30 18:22:01.932258 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-cde8a109-49ea-45ff-9c68-0db282d6b0c8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:22:01.933552 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-cde8a109-49ea-45ff-9c68-0db282d6b0c8 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012726 Jun 30 18:22:01.933552 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 26/52] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Jun 30 18:22:01 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 30 18:22:02.767664 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-2e144438-0da9-494e-80e6-bf566533e756 admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:22:02.768657 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-2e144438-0da9-494e-80e6-bf566533e756 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Jun 30 18:22:02.769043 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 27/53] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jun 30 18:22:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:22:02.959908 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-8eb2b3b4-5f61-476b-b4f2-0acc85cc5b6b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:22:02.978675 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-8eb2b3b4-5f61-476b-b4f2-0acc85cc5b6b admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.072138 Jun 30 18:22:02.979176 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 27/54] 10.222.0.33 () {64 vars in 1235 bytes} [Thu Jun 30 18:22:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 18:22:03.802474 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-2e144438-0da9-494e-80e6-bf566533e756 admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:22:03.803478 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-2e144438-0da9-494e-80e6-bf566533e756 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Jun 30 18:22:03.803871 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 28/55] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jun 30 18:22:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:22:03.997717 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-f5ea869a-2cf0-4eec-8da7-bf189132a05c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:22:04.016038 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-f5ea869a-2cf0-4eec-8da7-bf189132a05c admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.071146 Jun 30 18:22:04.016506 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 28/56] 10.222.0.33 () {64 vars in 1235 bytes} [Thu Jun 30 18:22:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 30 18:22:04.830589 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-2e144438-0da9-494e-80e6-bf566533e756 admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:22:04.831599 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-2e144438-0da9-494e-80e6-bf566533e756 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jun 30 18:22:04.832005 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 29/57] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jun 30 18:22:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:22:05.029756 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-f7acddd7-9beb-481f-acc2-f50e431005f5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:22:05.047718 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-f7acddd7-9beb-481f-acc2-f50e431005f5 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.076940 Jun 30 18:22:05.048207 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 29/58] 10.222.0.33 () {64 vars in 1235 bytes} [Thu Jun 30 18:22:04 2022] POST /compute/v2.1/flavors => generated 407 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 18:22:05.882287 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-2e144438-0da9-494e-80e6-bf566533e756 admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:22:05.883282 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-2e144438-0da9-494e-80e6-bf566533e756 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jun 30 18:22:05.883688 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 30/59] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jun 30 18:22:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:22:06.077465 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-1db3433e-0dcb-4af8-93f8-d224fe067200 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:22:06.095373 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-1db3433e-0dcb-4af8-93f8-d224fe067200 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.071711 Jun 30 18:22:06.095861 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 30/60] 10.222.0.33 () {64 vars in 1235 bytes} [Thu Jun 30 18:22:06 2022] POST /compute/v2.1/flavors => generated 409 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 18:22:06.927334 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-2e144438-0da9-494e-80e6-bf566533e756 admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:22:06.928443 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-2e144438-0da9-494e-80e6-bf566533e756 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jun 30 18:22:06.928783 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 31/61] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jun 30 18:22:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:22:07.121723 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-7c8d9ddc-88ac-4bf7-89ac-31076073bc66 admin admin] Calling method '>' {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:22:07.141841 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-7c8d9ddc-88ac-4bf7-89ac-31076073bc66 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.073361 Jun 30 18:22:07.142315 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 31/62] 10.222.0.33 () {60 vars in 1202 bytes} [Thu Jun 30 18:22:07 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:22:54.885888 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-2e144438-0da9-494e-80e6-bf566533e756 admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:22:54.886895 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-2e144438-0da9-494e-80e6-bf566533e756 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jun 30 18:22:54.887294 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 32/63] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 30 18:22:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:22:54.897529 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG dbcounter [-] [103221] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:22:54.949230 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-cefb1eab-5dfa-4b42-a6e4-910650eafb0c admin admin] Calling method '>' {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:22:54.968979 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-cefb1eab-5dfa-4b42-a6e4-910650eafb0c admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.075762 Jun 30 18:22:54.969524 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 32/64] 10.222.0.33 () {60 vars in 1291 bytes} [Thu Jun 30 18:22:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:22:54.992043 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-1461573c-4d39-42e9-ad8c-f40ccf3e5314 admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:22:54.995639 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG dbcounter [-] [103222] Writing DB stats nova_api:SELECT=14 {{(pid=103222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:22:55.002176 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-1461573c-4d39-42e9-ad8c-f40ccf3e5314 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013605 Jun 30 18:22:55.002754 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 33/65] 10.222.0.33 () {60 vars in 1282 bytes} [Thu Jun 30 18:22:54 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:22:55.016205 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-0baed773-5306-42fc-a870-981d149c63e3 admin admin] Calling method '>' {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:22:55.027693 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-0baed773-5306-42fc-a870-981d149c63e3 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015173 Jun 30 18:22:55.028635 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 33/66] 10.222.0.33 () {60 vars in 1285 bytes} [Thu Jun 30 18:22:55 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:22:55.041676 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-e1b9aefa-1846-4820-bc4a-693346f6219d admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:22:55.049593 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-e1b9aefa-1846-4820-bc4a-693346f6219d admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011959 Jun 30 18:22:55.050156 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 34/67] 10.222.0.33 () {60 vars in 1285 bytes} [Thu Jun 30 18:22:55 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:22:55.062726 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-7531cb2b-c6f5-4653-a179-4e463cd6c0d0 admin admin] Calling method '>' {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:22:55.070564 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-7531cb2b-c6f5-4653-a179-4e463cd6c0d0 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011674 Jun 30 18:22:55.071045 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 34/68] 10.222.0.33 () {60 vars in 1282 bytes} [Thu Jun 30 18:22:55 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:26:22.014477 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-e1b9aefa-1846-4820-bc4a-693346f6219d admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:22.015518 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-e1b9aefa-1846-4820-bc4a-693346f6219d admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jun 30 18:26:22.015912 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 35/69] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jun 30 18:26:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:26:22.156344 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG dbcounter [-] [103221] Writing DB stats nova_api:SELECT=6 {{(pid=103221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:26:22.270040 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-aeccc531-5477-48db-a723-c81eadc60cb5 admin admin] Calling method '>' {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:22.271213 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 18:26:22.271213 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: warnings.warn(msg) Jun 30 18:26:22.272405 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG oslo_concurrency.lockutils [None req-aeccc531-5477-48db-a723-c81eadc60cb5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:22.272842 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG oslo_concurrency.lockutils [None req-aeccc531-5477-48db-a723-c81eadc60cb5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:22.273650 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG oslo_concurrency.lockutils [None req-aeccc531-5477-48db-a723-c81eadc60cb5 admin admin] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:22.274082 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG oslo_concurrency.lockutils [None req-aeccc531-5477-48db-a723-c81eadc60cb5 admin admin] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:22.308427 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-aeccc531-5477-48db-a723-c81eadc60cb5 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.153479 Jun 30 18:26:22.308981 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 35/70] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Jun 30 18:26:22 2022] GET /compute/v2.1/os-services => generated 791 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 30 18:26:23.143713 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-e1b9aefa-1846-4820-bc4a-693346f6219d admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:23.144706 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-e1b9aefa-1846-4820-bc4a-693346f6219d admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Jun 30 18:26:23.145097 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 36/71] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jun 30 18:26:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:26:23.338884 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-c684a7f1-656a-435d-8b2f-8835a1af7e42 admin admin] Calling method '>' {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:23.340111 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 18:26:23.340111 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: warnings.warn(msg) Jun 30 18:26:23.341275 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG oslo_concurrency.lockutils [None req-c684a7f1-656a-435d-8b2f-8835a1af7e42 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:23.341771 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG oslo_concurrency.lockutils [None req-c684a7f1-656a-435d-8b2f-8835a1af7e42 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:23.342548 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG oslo_concurrency.lockutils [None req-c684a7f1-656a-435d-8b2f-8835a1af7e42 admin admin] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:23.342967 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG oslo_concurrency.lockutils [None req-c684a7f1-656a-435d-8b2f-8835a1af7e42 admin admin] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:23.362997 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-c684a7f1-656a-435d-8b2f-8835a1af7e42 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076856 Jun 30 18:26:23.363536 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 36/72] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Jun 30 18:26:23 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 18:26:34.630199 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-e1b9aefa-1846-4820-bc4a-693346f6219d admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:34.631233 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-e1b9aefa-1846-4820-bc4a-693346f6219d admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jun 30 18:26:34.631631 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 37/73] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jun 30 18:26:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:26:34.776787 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG dbcounter [-] [103221] Writing DB stats nova_cell0:SELECT=4 {{(pid=103221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:26:34.777506 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG dbcounter [-] [103221] Writing DB stats nova_cell1:SELECT=4 {{(pid=103221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:26:34.778153 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG dbcounter [-] [103221] Writing DB stats nova_api:SELECT=8 {{(pid=103221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:26:34.828010 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-59f145c0-3560-4ea4-a96f-42452b4fd23c admin admin] Calling method '>' {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:34.829212 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 18:26:34.829212 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: warnings.warn(msg) Jun 30 18:26:34.830433 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG oslo_concurrency.lockutils [None req-59f145c0-3560-4ea4-a96f-42452b4fd23c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:34.830878 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG oslo_concurrency.lockutils [None req-59f145c0-3560-4ea4-a96f-42452b4fd23c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:34.831659 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG oslo_concurrency.lockutils [None req-59f145c0-3560-4ea4-a96f-42452b4fd23c admin admin] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:34.832085 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG oslo_concurrency.lockutils [None req-59f145c0-3560-4ea4-a96f-42452b4fd23c admin admin] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:34.858121 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-59f145c0-3560-4ea4-a96f-42452b4fd23c admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.086399 Jun 30 18:26:34.858612 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 37/74] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Jun 30 18:26:34 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:26:35.707906 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-e1b9aefa-1846-4820-bc4a-693346f6219d admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:35.708898 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-e1b9aefa-1846-4820-bc4a-693346f6219d admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Jun 30 18:26:35.709290 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 38/75] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jun 30 18:26:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:26:35.901230 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-1a7abfc3-0477-439b-b322-c83738128a80 admin admin] Calling method '>' {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:35.902441 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 18:26:35.902441 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: warnings.warn(msg) Jun 30 18:26:35.903611 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG oslo_concurrency.lockutils [None req-1a7abfc3-0477-439b-b322-c83738128a80 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:35.904051 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG oslo_concurrency.lockutils [None req-1a7abfc3-0477-439b-b322-c83738128a80 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:35.904841 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG oslo_concurrency.lockutils [None req-1a7abfc3-0477-439b-b322-c83738128a80 admin admin] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:35.905273 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: DEBUG oslo_concurrency.lockutils [None req-1a7abfc3-0477-439b-b322-c83738128a80 admin admin] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:35.927448 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-1a7abfc3-0477-439b-b322-c83738128a80 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.078485 Jun 30 18:26:35.927946 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 38/76] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Jun 30 18:26:35 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:27:33.449299 dv-cinder-803785-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 30 18:27:33.449889 dv-cinder-803785-1-iscsi devstack@n-api.service[103220]: Thu Jun 30 18:27:33 2022 - graceful shutdown triggered... Jun 30 18:27:33.450331 dv-cinder-803785-1-iscsi devstack@n-api.service[103221]: Gracefully killing worker 1 (pid: 103221)... Jun 30 18:27:33.450686 dv-cinder-803785-1-iscsi devstack@n-api.service[103222]: Gracefully killing worker 2 (pid: 103222)... Jun 30 18:27:34.451033 dv-cinder-803785-1-iscsi devstack@n-api.service[103220]: worker 1 buried after 1 seconds Jun 30 18:27:34.451447 dv-cinder-803785-1-iscsi devstack@n-api.service[103220]: worker 2 buried after 1 seconds Jun 30 18:27:34.451447 dv-cinder-803785-1-iscsi devstack@n-api.service[103220]: goodbye to uWSGI. Jun 30 18:27:34.452695 dv-cinder-803785-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 30 18:27:34.453241 dv-cinder-803785-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 30 18:27:34.456051 dv-cinder-803785-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 30 18:27:34.466354 dv-cinder-803785-1-iscsi devstack@n-api.service[117928]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 30 18:27:34.468334 dv-cinder-803785-1-iscsi devstack@n-api.service[117928]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 30 18:27:34 2022] *** Jun 30 18:27:34.468334 dv-cinder-803785-1-iscsi devstack@n-api.service[117928]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 30 18:27:34.468334 dv-cinder-803785-1-iscsi devstack@n-api.service[117928]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 30 18:27:34.468334 dv-cinder-803785-1-iscsi devstack@n-api.service[117928]: nodename: dv-cinder-803785-1-iscsi Jun 30 18:27:34.468334 dv-cinder-803785-1-iscsi devstack@n-api.service[117928]: machine: x86_64 Jun 30 18:27:34.468334 dv-cinder-803785-1-iscsi devstack@n-api.service[117928]: clock source: unix Jun 30 18:27:34.468334 dv-cinder-803785-1-iscsi devstack@n-api.service[117928]: pcre jit disabled Jun 30 18:27:34.468334 dv-cinder-803785-1-iscsi devstack@n-api.service[117928]: detected number of CPU cores: 4 Jun 30 18:27:34.468334 dv-cinder-803785-1-iscsi devstack@n-api.service[117928]: current working directory: / Jun 30 18:27:34.468334 dv-cinder-803785-1-iscsi devstack@n-api.service[117928]: detected binary path: /usr/bin/uwsgi-core Jun 30 18:27:34.468334 dv-cinder-803785-1-iscsi devstack@n-api.service[117928]: your processes number limit is 47680 Jun 30 18:27:34.468334 dv-cinder-803785-1-iscsi devstack@n-api.service[117928]: your memory page size is 4096 bytes Jun 30 18:27:34.468334 dv-cinder-803785-1-iscsi devstack@n-api.service[117928]: detected max file descriptor number: 2048 Jun 30 18:27:34.468334 dv-cinder-803785-1-iscsi devstack@n-api.service[117928]: lock engine: pthread robust mutexes Jun 30 18:27:34.469233 dv-cinder-803785-1-iscsi devstack@n-api.service[117928]: thunder lock: enabled Jun 30 18:27:34.469233 dv-cinder-803785-1-iscsi devstack@n-api.service[117928]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 30 18:27:34.469233 dv-cinder-803785-1-iscsi devstack@n-api.service[117928]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 30 18:27:34.513131 dv-cinder-803785-1-iscsi devstack@n-api.service[117928]: Python main interpreter initialized at 0x55cc273e49c0 Jun 30 18:27:34.513131 dv-cinder-803785-1-iscsi devstack@n-api.service[117928]: python threads support enabled Jun 30 18:27:34.513131 dv-cinder-803785-1-iscsi devstack@n-api.service[117928]: your server socket listen backlog is limited to 100 connections Jun 30 18:27:34.513131 dv-cinder-803785-1-iscsi devstack@n-api.service[117928]: your mercy for graceful operations on workers is 90 seconds Jun 30 18:27:34.513546 dv-cinder-803785-1-iscsi devstack@n-api.service[117928]: mapped 403077 bytes (393 KB) for 2 cores Jun 30 18:27:34.513546 dv-cinder-803785-1-iscsi devstack@n-api.service[117928]: *** Operational MODE: preforking *** Jun 30 18:27:34.513849 dv-cinder-803785-1-iscsi devstack@n-api.service[117928]: *** uWSGI is running in multiple interpreter mode *** Jun 30 18:27:34.514050 dv-cinder-803785-1-iscsi devstack@n-api.service[117928]: spawned uWSGI master process (pid: 117928) Jun 30 18:27:34.514765 dv-cinder-803785-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 30 18:27:34.516350 dv-cinder-803785-1-iscsi devstack@n-api.service[117928]: spawned uWSGI worker 1 (pid: 117940, cores: 1) Jun 30 18:27:34.516889 dv-cinder-803785-1-iscsi devstack@n-api.service[117928]: spawned uWSGI worker 2 (pid: 117941, cores: 1) Jun 30 18:27:34.517357 dv-cinder-803785-1-iscsi devstack@n-api.service[117928]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 30 18:27:35.183915 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 30 18:27:35.207021 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 30 18:27:36.398366 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 18:27:36.398366 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: from cryptography.utils import int_from_bytes Jun 30 18:27:36.398980 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 18:27:36.398980 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: from cryptography.utils import int_from_bytes Jun 30 18:27:36.448443 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 18:27:36.448443 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: from cryptography.utils import int_from_bytes Jun 30 18:27:36.449052 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 18:27:36.449052 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: from cryptography.utils import int_from_bytes Jun 30 18:27:38.881740 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 30 18:27:38.882352 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 30 18:27:38.882675 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 30 18:27:38.882919 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 30 18:27:38.883184 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 30 18:27:38.883589 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.883925 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.884828 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.885169 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.885509 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.885860 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.886195 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.886523 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.886860 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.887128 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.887451 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.887784 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-803785-1-iscsi {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.888119 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.888439 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.888758 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.889139 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.889460 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.889832 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.890147 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.890662 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.893730 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.893730 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.893730 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.893730 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.893730 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.893730 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.893730 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.893730 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.894426 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.894426 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.894426 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-803785-1-iscsi {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.897995 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.897995 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.897995 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.897995 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.897995 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.897995 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.897995 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.897995 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.898685 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.898685 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.898685 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.898685 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.898685 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.899027 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.899377 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.899553 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.900939 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.900939 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.901307 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.901461 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.901656 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.901999 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.902330 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.902663 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.902926 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.903189 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.903514 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.903902 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.904162 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.904484 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.904793 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.905108 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.905424 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.905767 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.906083 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.906398 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.906727 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.907051 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.907383 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.907700 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.908027 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.908446 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.908705 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.909019 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.909375 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.909727 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.910046 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.910375 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.910707 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.911023 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.911339 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.911652 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.911999 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.912498 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.912675 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.912985 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.913167 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.913483 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.913955 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.914197 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.914473 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.914758 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.915059 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.915860 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.916042 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.916255 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.916669 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.916989 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.917306 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.917647 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.918002 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.918267 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.918602 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.918932 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.919256 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.919571 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.919886 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.920201 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.920528 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.920842 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.921154 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.923690 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.923690 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.923690 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.923690 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.923690 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.923690 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.923690 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.924863 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.924863 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.924863 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.924863 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.925444 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.925444 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.925778 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.927931 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.927931 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.927931 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.927931 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.927931 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.927931 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.927931 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.929010 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.929010 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.929010 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.929010 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.929603 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.929759 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.930093 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.930416 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.930761 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.931282 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.931809 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.932138 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.932465 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.932807 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.933132 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.933454 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.934087 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.934418 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.934749 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.935093 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.935423 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.935752 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.936084 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.936407 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.936740 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.937075 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.937417 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.937763 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.938121 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.938479 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.938803 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.939138 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.939492 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.939801 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.940290 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.940758 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.941247 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.941765 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.942276 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.942760 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.943248 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.943733 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.944215 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.944700 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.945188 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.945737 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.946211 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.947233 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.947701 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.948188 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.948686 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.949165 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.949659 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.950134 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.950594 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.951087 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.951581 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.952051 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.952547 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.953050 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.953522 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.954524 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.954524 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.955498 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.955856 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.956191 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.956540 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.956934 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.957194 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.957519 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.958039 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.958394 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.958696 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.959182 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.959673 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.960147 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.960623 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.961128 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.961635 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.962176 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.962774 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.963189 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.963706 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.964030 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.964392 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.964763 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.965084 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.965414 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.965779 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.966113 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.966432 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.966760 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.967078 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.967389 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.967936 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.968233 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.968622 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.968882 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.969185 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.969506 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.969993 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.970238 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.970732 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.971068 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 30 18:27:38.971548 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.971642 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 30 18:27:38.971739 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.971919 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 30 18:27:38.972122 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.972288 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 30 18:27:38.972609 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.972906 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 30 18:27:38.973025 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.973275 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.973402 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.973652 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.973994 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.974312 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.974437 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.974646 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.974977 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.975212 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.975323 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.975614 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.975935 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.976119 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.976258 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.976593 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.976887 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.977016 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.977234 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.977558 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.977729 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.978013 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.978408 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.978824 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.979190 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.979308 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.979512 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.979651 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.979844 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.980202 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.980421 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.980542 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.980869 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.981147 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.981275 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.981511 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.981865 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.982076 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-803785-1-iscsi {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.982185 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.982492 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.982812 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.983037 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.983146 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.983447 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.983748 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.983869 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.984076 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.984389 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.984738 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.984878 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.985058 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.985400 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.985754 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.986003 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.986277 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.986597 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.986838 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.986970 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.987224 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.987572 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.987692 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.987896 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.988016 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.988246 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.988368 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.988590 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.988693 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.988903 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.989038 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.989551 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.990057 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.990233 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.990599 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.990870 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.991046 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-803785-1-iscsi {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.991479 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.991663 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.991971 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.992294 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.992409 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.992738 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.993046 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.993160 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.993369 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.994270 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.994479 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.994973 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.995320 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.995628 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.995750 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.995990 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.996328 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.996523 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.996639 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.996977 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.997256 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.997383 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.997608 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.997948 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.998631 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.998735 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.998823 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.998909 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.998909 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.999109 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.999443 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:38.999625 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:38.999780 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.000108 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.000427 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.000539 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.000685 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.001027 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.001295 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.001423 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.001693 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.002011 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.002219 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.002719 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.002832 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.003040 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.003356 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.003621 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.003741 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.003972 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.004286 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.004530 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.004639 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.004906 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.005227 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.005415 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.005534 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.005889 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.006195 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.006308 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.006606 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.006864 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.007092 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.007572 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.007694 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.008036 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.008315 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.008431 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.008661 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.008988 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.009312 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.009535 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.009962 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.010077 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.010570 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.010708 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.010868 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.011007 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.011253 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.011622 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.011750 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.011920 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.012108 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.012427 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.012634 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.012900 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.013236 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.013389 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.013569 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.013712 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.013952 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.014225 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.014623 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.014722 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.014833 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.014925 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.015006 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.015148 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.015257 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.015577 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.015867 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.015982 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.016219 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.016547 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.016857 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.016962 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.017199 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.017527 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.018167 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.018248 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.018524 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.018836 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.019059 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.019204 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.019731 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.019872 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.020064 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.020189 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.020416 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.020657 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.020771 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.021071 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.025348 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.025469 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.025607 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.025742 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.025742 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.025932 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.026029 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.026105 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.026263 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.026349 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.026469 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.026558 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.026632 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.026712 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.026784 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.026854 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.026932 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.027015 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.027095 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.027167 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.027252 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.027325 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.028410 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.028618 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.028786 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.028948 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.028948 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.029269 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.029424 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.029656 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.029824 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.029985 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.030148 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.030331 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.030515 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.030710 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.030875 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.030875 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.030875 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.030875 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.030875 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.030875 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.030875 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.030875 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.033241 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.033241 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.033241 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.033241 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.035604 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.035842 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.036950 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.037152 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.037313 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.037468 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.037676 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.037879 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.038036 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.039122 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.039300 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.039464 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.039629 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.039848 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.040019 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.040182 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.040374 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.041121 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.041284 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.041445 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.041653 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.042223 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.042387 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.042551 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.042713 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.042867 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.043019 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.043617 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.043781 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.044124 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.044124 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.044658 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.044813 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.045570 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.045797 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.045991 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.046164 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.046396 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.046562 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.046937 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 18:27:39.047114 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.047278 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.047432 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.047600 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.047754 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.047914 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.048110 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.048278 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.048431 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.048600 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.048762 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.048922 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.049076 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.049276 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.049276 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.049625 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.049799 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.049960 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.049960 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.050359 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.050532 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.050695 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.050854 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.051007 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.051173 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.051345 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.051509 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.052595 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.052763 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.052927 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.053096 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.053309 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.053479 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.053664 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.053825 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.053977 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.054641 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.054823 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.054992 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.055153 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.055305 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.055464 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.055627 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.055800 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.055954 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.056182 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.056340 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.056492 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.056645 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.056806 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.056960 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.057128 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.057287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.057506 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.057744 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.058124 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.058234 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.058234 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.058414 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.058554 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.058659 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.058998 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.059102 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.059189 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.059281 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.059375 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.059474 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.059722 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.059864 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.059985 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.060104 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.060658 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.060808 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.060964 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.061110 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.061231 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.061381 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.061381 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.061716 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.061837 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.061957 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.062101 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.062582 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.062718 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.062833 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.062957 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.063068 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.063177 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.063311 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.063506 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.063631 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.063744 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.063873 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.064020 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.064140 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.064428 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.064915 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.065062 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.065202 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.065341 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.065470 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.065659 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.065801 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.065931 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.066070 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.066209 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.066348 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.066478 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.066607 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.066735 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.066871 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.066871 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.067142 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.067280 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.067416 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.067517 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.067611 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.067611 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.067776 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.067862 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.067947 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.067947 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.067947 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.067947 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.067947 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.068337 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.068421 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.068504 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.068596 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.068695 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.068781 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.068873 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.069027 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.069163 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.069301 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.070127 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.070277 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.070376 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.070470 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.070557 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.070642 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.070741 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.070827 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.070912 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.071005 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.071091 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.071185 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.071280 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.071366 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.071458 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.071551 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.071729 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.071837 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.071925 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.072010 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.072082 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.072181 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.072310 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.072633 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.072732 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.072732 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.072900 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.072986 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.073069 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.073164 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.073251 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.073343 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.073437 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.073530 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.073669 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.073767 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.073862 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.073948 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.074033 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.074117 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.074199 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.074292 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.074377 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.074635 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.074914 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.075008 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.075105 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.075193 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.075278 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.075362 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.075446 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.075538 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.075634 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.075780 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.075905 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.075994 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.076086 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.076186 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.076186 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.076360 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.076447 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.076533 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.076624 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.076725 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.076811 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.076904 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.076990 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.077082 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.077176 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.077271 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.077358 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.077450 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.077626 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.077719 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.077804 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.077909 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.078006 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.078092 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.078184 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.078270 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.078356 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.078442 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.078533 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.078626 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.078719 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.078814 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.078914 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.079051 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.079146 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.079241 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.079328 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.079420 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.079515 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.079601 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.079694 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.079780 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.079871 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.079964 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.080059 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.080146 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.080230 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.080331 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.080426 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.080528 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.080617 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.080709 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.080795 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.080888 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.080975 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.081137 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.081226 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.081311 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.081403 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.081489 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.081596 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.081596 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.081779 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.081874 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.081967 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.082098 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.082236 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.082341 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.082429 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.082591 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.082687 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.082809 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.082898 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.082979 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.083058 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.083131 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.083209 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.083281 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.083360 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.083441 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.083513 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.083583 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.083652 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.083723 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.083807 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.083880 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.083880 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.083880 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.084080 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.084150 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.084389 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.084499 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.084803 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.084906 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.085056 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.085149 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.085327 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.085411 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.085687 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.085792 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.085999 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.086092 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.086322 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.086406 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.086636 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.086727 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.087014 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.087120 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.087761 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.087863 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.088145 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.088260 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.088379 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.088485 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.088690 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.088793 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.089006 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.089100 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.089318 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.089431 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.089732 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.089886 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.090017 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.090170 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.090309 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.090491 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.090612 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.090979 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.091121 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.091234 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.091361 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.091481 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.091601 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.091751 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.092191 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.092191 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.092503 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.092601 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.092738 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.092871 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.093010 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.093109 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.093262 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.093400 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.093593 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.093773 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.093925 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.094092 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.094238 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.094435 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.094543 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.094921 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.095075 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.095198 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.095286 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.095412 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.095488 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.095669 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.095826 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.095957 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.096172 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.096268 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.096494 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.096589 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.096822 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.096927 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.097138 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.097270 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.097459 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.097557 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.097802 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.097907 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.098116 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.098209 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.098432 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.098533 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.098745 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.098847 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.099055 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.099147 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.099369 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.099474 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.099681 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.099785 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.099992 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.100095 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.100303 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.100406 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.100629 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.100732 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.100943 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.101037 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.101256 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.101364 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.101568 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.101743 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.101893 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.101989 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.102204 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.102307 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.102523 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.102674 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.103010 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.103165 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.103669 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.103669 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.103958 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.104043 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.104285 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.104366 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.104609 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.104714 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.104974 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.105078 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.105250 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.105492 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.105719 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.105901 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.105998 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.106205 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.106298 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.106529 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.106626 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.106846 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.106927 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.107153 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.107252 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.107484 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.107575 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.107768 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.107866 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.108075 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.108161 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.108376 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.108459 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.108681 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.108772 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.108992 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.109116 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.109297 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.109379 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.109611 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.109713 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.109921 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.110050 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.110228 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.110326 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.110542 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.110635 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.110848 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.110938 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.111161 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.111252 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.111465 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.111595 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.111786 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.111915 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.112098 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.112233 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.112402 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.112557 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.112705 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.112881 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.113008 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.113197 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.113350 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.113517 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.113693 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.114011 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.114342 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.114493 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.114709 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.114847 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.115003 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.115202 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.115349 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.115559 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.115721 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.115848 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.115990 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.116175 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.116294 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.116421 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.116553 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.116665 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.116776 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.116922 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.117054 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.117275 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.117402 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.117602 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.117741 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.117946 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.118112 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.118245 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.119010 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.119329 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.119492 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.119664 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.119826 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.120015 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.120115 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.120356 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.120451 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.120693 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.120797 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.121008 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.121107 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.121317 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.121437 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.121643 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.121745 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.121960 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.122093 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.122270 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.122374 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.122574 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.122669 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.122884 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.122978 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.123189 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.123298 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.123505 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.123607 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.123810 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.123903 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.124115 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.124223 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.124421 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.124523 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.124736 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.124885 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.125047 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.125293 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.125407 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.125686 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.125794 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.125996 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.126166 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.126318 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.126418 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.126594 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.126697 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.126904 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.127013 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.127207 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.127309 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.127509 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.127605 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.127818 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.127927 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.128143 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.128237 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.128460 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.128562 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.128765 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.128868 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.129075 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.129179 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.129380 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.129475 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.129707 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.129820 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.130044 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.130179 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.130318 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.130414 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.130621 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.130725 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.130923 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.131025 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.131227 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.131321 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.131529 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.131632 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.131833 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.131980 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.132155 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.132250 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.132467 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.132573 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.132776 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.132870 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.133082 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.133192 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.133386 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.133490 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.133717 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.133813 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.134043 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.134244 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.134468 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.134608 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.134796 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.134917 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.135108 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.135222 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.135430 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.135544 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.135742 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.135837 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.136062 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.136178 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.136417 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.136512 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.136724 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.136825 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.137039 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.137143 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.137351 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.137444 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.137703 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.137821 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.138001 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.138135 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.138304 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.138402 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.138625 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.138728 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.138937 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.139042 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.139250 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.139343 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.139570 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.139666 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.139893 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.140137 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.140273 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.140487 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.140591 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.140801 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.140905 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.141113 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.141219 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.141422 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.141524 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.141755 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.141861 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.142067 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.142161 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.142378 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.142470 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.142689 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.142793 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.142999 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.143102 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.143313 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.143416 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.143625 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.143721 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.143932 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.144026 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.144242 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.144347 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.144557 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.144651 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.144862 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.144956 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.145187 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.145318 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.145500 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.145659 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.145829 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.145933 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.146141 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.146245 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.146459 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.146557 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.146781 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.146888 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.147106 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.147215 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.147456 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.147552 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.147786 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.147880 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.148115 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.148216 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.148433 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.148540 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.148744 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.148838 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.149054 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.149148 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.149367 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.149468 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.149703 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.150380 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.150556 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.150702 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.150862 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.150985 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.151206 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.151325 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.151521 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.151617 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.151828 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.151932 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.152134 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.152348 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.152445 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.152671 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.152765 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.153000 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.153104 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.153329 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.153426 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.153652 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.153749 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.154005 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.154117 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.154284 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.154396 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.154590 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.154692 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.154927 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.155249 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.155518 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.155670 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.155919 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.156020 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.156250 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.156357 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.156562 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.156670 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.156882 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.156984 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.157197 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.157303 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.157511 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.157652 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.157915 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.158007 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.158240 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.158336 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.158564 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.158659 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.158872 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.158966 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.159188 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.159290 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.159498 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.159592 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.159808 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.159907 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.160117 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.160214 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.160452 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.160554 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.160738 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.160833 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.161044 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.161223 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.161384 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.161541 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.161678 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.161781 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.161966 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.162069 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.162275 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.162370 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.162585 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.162696 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.162894 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.162997 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.163209 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.163305 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.163519 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.163624 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.163830 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.163933 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.164139 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.164241 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.164450 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.164556 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.164758 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.164861 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.165096 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.165189 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.165478 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.165606 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.165837 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.165947 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.166149 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.166264 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.166461 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.166558 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.166774 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.166926 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.167086 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.167191 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.167387 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.167528 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.167749 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.167986 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.168084 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.168319 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.168441 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.168628 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.168731 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.168957 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.169052 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.169276 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.169381 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.169621 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.169722 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.169949 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.170052 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.170255 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.170350 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.170575 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.170674 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.171239 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.171348 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.171448 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.171544 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.171640 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.171804 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.171896 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.171989 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.172090 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.172185 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.172400 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.172495 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.172721 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.172825 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.173052 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.173147 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.173381 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.173474 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.173714 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.173836 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.174033 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.174127 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.174354 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.174634 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.174759 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.174963 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.175070 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.175283 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.175385 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.175604 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.175718 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.175909 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.176011 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.176216 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.176319 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.176530 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.176644 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.176836 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.176963 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.177138 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.177242 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.177442 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.177546 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.177775 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.177885 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.178079 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.178214 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.178380 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.178551 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.178684 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.178872 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.179005 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.179190 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.179296 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.179500 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.179623 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.179748 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 30 18:27:39.179934 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.180240 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.180544 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.180851 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.181748 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.182061 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.182395 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.182712 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.183033 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.183363 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.183675 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.184264 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.184590 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.184908 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.185224 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.185539 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.185877 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.186193 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.186534 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.186846 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.187163 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.187476 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.187793 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.188333 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.188663 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.188981 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.189294 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.189687 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.190003 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.190316 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.190629 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.190944 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.191252 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.191562 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.191893 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.192234 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.192559 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.192897 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.193215 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.193532 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.193876 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.194191 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.194553 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.194870 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.195179 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.195493 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.195808 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.196123 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.196435 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.197487 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.197878 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.198201 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.198519 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.198834 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.199149 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.199465 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.199793 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.200130 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.200453 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.200768 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.201085 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.201400 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.201947 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.202264 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.202598 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.202926 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.203251 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.203568 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.203888 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.204216 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.204529 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.204834 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.205146 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.205456 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.205784 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.206110 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.206426 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.206732 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.207054 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.207381 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.207898 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.208248 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.208567 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.208896 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.209220 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.209538 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.209869 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.210195 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.210505 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.210814 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.211130 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.211442 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.211748 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.212055 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.212431 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.212761 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.213070 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.213382 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.213710 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.214039 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.214349 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.214656 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.214963 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.215277 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.215585 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.215889 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.216195 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.216568 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.216808 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.217113 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.217422 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.217750 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.218062 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.218365 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.218674 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.219019 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.219343 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.219648 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.219953 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.220267 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.220579 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.220899 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.221213 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.221519 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.221897 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.222209 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.222737 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.223070 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.223391 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.223724 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.224055 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.224369 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.224675 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.224979 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.225301 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.225629 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.225947 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.226258 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.226571 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.226883 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.227192 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.227503 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.227811 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.228170 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.228458 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.228769 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.229077 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.229387 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.229722 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.230069 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.230390 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.230736 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.231053 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.231372 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.231680 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.231990 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.232298 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.232607 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.232920 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.233247 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.233560 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.233885 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.234397 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.234711 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.235030 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.235350 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.235659 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.235979 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.236300 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.236610 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.236930 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.237238 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.237565 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.237922 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.238248 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.238570 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.238941 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.239253 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.239558 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.239866 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.240184 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.240493 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.240795 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.241095 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.241405 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.241731 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.242034 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.242453 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.242652 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.242796 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO dbcounter [None req-32b2a47b-8853-43af-9276-663d2abb642c None None] Registered counter for database nova_api Jun 30 18:27:39.242961 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.243262 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.244101 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.244389 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.244802 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.245110 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.245715 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.246029 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.246331 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.246634 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.246937 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.247238 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.247539 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.247872 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.248206 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.248524 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.248846 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.249157 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.249480 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.249812 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.250137 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.250459 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.250772 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.251085 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.251432 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.251730 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.252041 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.252353 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.252665 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.252979 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.253288 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.253684 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.254019 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.254323 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.254645 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.254963 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.255280 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.255594 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.255904 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.256229 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.256536 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.256845 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.257157 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.257464 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.257794 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.258122 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.258614 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.259022 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.259269 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.259695 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.260028 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.260359 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.260709 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.261025 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.261370 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.261730 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.262049 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.262384 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.264735 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 18:27:39.264735 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 30 18:27:39.265061 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_db.sqlalchemy.engines [None req-32b2a47b-8853-43af-9276-663d2abb642c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117940) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 18:27:39.270575 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writer thread running {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 18:27:39.327409 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO dbcounter [None req-6208dde5-44eb-4478-a1a2-dd1bc0e0a4e6 None None] Registered counter for database nova_api Jun 30 18:27:39.334128 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.context [None req-32b2a47b-8853-43af-9276-663d2abb642c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c(cell1) {{(pid=117940) load_cells /opt/stack/nova/nova/context.py:464}} Jun 30 18:27:39.338414 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-32b2a47b-8853-43af-9276-663d2abb642c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:39.340024 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-32b2a47b-8853-43af-9276-663d2abb642c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:39.340836 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-32b2a47b-8853-43af-9276-663d2abb642c None None] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:39.342824 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-32b2a47b-8853-43af-9276-663d2abb642c None None] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:39.344847 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO dbcounter [None req-32b2a47b-8853-43af-9276-663d2abb642c None None] Registered counter for database nova_cell0 Jun 30 18:27:39.347239 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_db.sqlalchemy.engines [None req-6208dde5-44eb-4478-a1a2-dd1bc0e0a4e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117941) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 18:27:39.348948 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO dbcounter [None req-32b2a47b-8853-43af-9276-663d2abb642c None None] Registered counter for database nova_cell1 Jun 30 18:27:39.354635 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writer thread running {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 18:27:39.356920 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_db.sqlalchemy.engines [None req-32b2a47b-8853-43af-9276-663d2abb642c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117940) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 18:27:39.358786 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_db.sqlalchemy.engines [None req-32b2a47b-8853-43af-9276-663d2abb642c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117940) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 18:27:39.365215 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writer thread running {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 18:27:39.366535 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writer thread running {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 18:27:39.411293 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.context [None req-6208dde5-44eb-4478-a1a2-dd1bc0e0a4e6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c(cell1) {{(pid=117941) load_cells /opt/stack/nova/nova/context.py:464}} Jun 30 18:27:39.415294 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6208dde5-44eb-4478-a1a2-dd1bc0e0a4e6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:39.417597 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6208dde5-44eb-4478-a1a2-dd1bc0e0a4e6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:39.418380 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6208dde5-44eb-4478-a1a2-dd1bc0e0a4e6 None None] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:39.420467 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6208dde5-44eb-4478-a1a2-dd1bc0e0a4e6 None None] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:39.423271 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO dbcounter [None req-6208dde5-44eb-4478-a1a2-dd1bc0e0a4e6 None None] Registered counter for database nova_cell0 Jun 30 18:27:39.427965 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO dbcounter [None req-6208dde5-44eb-4478-a1a2-dd1bc0e0a4e6 None None] Registered counter for database nova_cell1 Jun 30 18:27:39.436327 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_db.sqlalchemy.engines [None req-6208dde5-44eb-4478-a1a2-dd1bc0e0a4e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117941) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 18:27:39.438658 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_db.sqlalchemy.engines [None req-6208dde5-44eb-4478-a1a2-dd1bc0e0a4e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117941) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 18:27:39.448418 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writer thread running {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 18:27:39.448756 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writer thread running {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 18:27:39.518958 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO dbcounter [None req-32b2a47b-8853-43af-9276-663d2abb642c None None] Registered counter for database nova_cell0 Jun 30 18:27:39.530044 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_db.sqlalchemy.engines [None req-32b2a47b-8853-43af-9276-663d2abb642c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117940) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 18:27:39.534996 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writer thread running {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 18:27:39.604471 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO dbcounter [None req-6208dde5-44eb-4478-a1a2-dd1bc0e0a4e6 None None] Registered counter for database nova_cell0 Jun 30 18:27:39.615826 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_db.sqlalchemy.engines [None req-6208dde5-44eb-4478-a1a2-dd1bc0e0a4e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117941) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 18:27:39.621064 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writer thread running {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 18:27:39.882337 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: WARNING keystonemiddleware.auth_token [None req-32b2a47b-8853-43af-9276-663d2abb642c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 18:27:39.890296 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: WARNING keystonemiddleware.auth_token [None req-32b2a47b-8853-43af-9276-663d2abb642c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 18:27:39.944678 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: WARNING keystonemiddleware.auth_token [None req-6208dde5-44eb-4478-a1a2-dd1bc0e0a4e6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 18:27:39.952438 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: WARNING keystonemiddleware.auth_token [None req-6208dde5-44eb-4478-a1a2-dd1bc0e0a4e6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 18:27:40.258026 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: WARNING keystonemiddleware.auth_token [None req-32b2a47b-8853-43af-9276-663d2abb642c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 18:27:40.264700 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: WARNING keystonemiddleware.auth_token [None req-32b2a47b-8853-43af-9276-663d2abb642c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 18:27:40.270146 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cc273e49c0 pid: 117940 (default app) Jun 30 18:27:40.304258 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: WARNING keystonemiddleware.auth_token [None req-6208dde5-44eb-4478-a1a2-dd1bc0e0a4e6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 18:27:40.311490 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: WARNING keystonemiddleware.auth_token [None req-6208dde5-44eb-4478-a1a2-dd1bc0e0a4e6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 18:27:40.316769 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cc273e49c0 pid: 117941 (default app) Jun 30 18:28:22.085801 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_api:SELECT=3 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:28:22.087483 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell0:SELECT=3 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:28:22.088225 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell1:SELECT=3 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:28:22.090090 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell0:SELECT=3 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:28:24.218211 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-22e1a5a3-0cab-493f-b0fb-56639c0e95a0 tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] Action: 'create', calling method: .version_select at 0x7f1806c4c3a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1258491420"}} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:28:26.228600 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_api:SELECT=3 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:28:26.229805 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell1:SELECT=3 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:28:26.230724 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell0:SELECT=3 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:28:26.234305 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell0:SELECT=3 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:28:26.444695 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-22e1a5a3-0cab-493f-b0fb-56639c0e95a0 tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.363960 Jun 30 18:28:26.446132 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 1/1] 10.222.0.33 () {60 vars in 1154 bytes} [Thu Jun 30 18:28:22 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4368 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 30 18:28:26.460362 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-593fabd2-9049-40bf-8ae8-60fde360edba tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] Calling method '.version_select at 0x7f1806b1e280>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:26.594283 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-593fabd2-9049-40bf-8ae8-60fde360edba tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/99280eab-183e-451a-87de-45e913e4143a" status: 200 len: 345 microversion: 2.1 time: 0.138908 Jun 30 18:28:26.595295 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 2/2] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 30 18:28:26 2022] GET /compute/v2.1/os-volumes/99280eab-183e-451a-87de-45e913e4143a => generated 345 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:28:26.670442 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-38225406-65ad-410b-a23d-11046543509b tempest-VolumesTestJSON-42413476 tempest-VolumesTestJSON-42413476-project] Calling method '.version_select at 0x7f1806c940d0>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:27.390454 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-38225406-65ad-410b-a23d-11046543509b tempest-VolumesTestJSON-42413476 tempest-VolumesTestJSON-42413476-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/2e5e3d27-98d1-471a-9bb7-43fbeed79c37" status: 200 len: 351 microversion: 2.1 time: 1.167748 Jun 30 18:28:27.392030 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 1/3] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 30 18:28:26 2022] GET /compute/v2.1/os-volumes/2e5e3d27-98d1-471a-9bb7-43fbeed79c37 => generated 351 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:28:27.607586 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-e51b5797-a39f-4c25-a226-95a16643cf4d tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] Calling method '.version_select at 0x7f1806b1e5e0>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:28.582880 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-e51b5797-a39f-4c25-a226-95a16643cf4d tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/99280eab-183e-451a-87de-45e913e4143a" status: 200 len: 346 microversion: 2.1 time: 0.979498 Jun 30 18:28:28.583745 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 3/4] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 30 18:28:27 2022] GET /compute/v2.1/os-volumes/99280eab-183e-451a-87de-45e913e4143a => generated 346 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:28:28.599242 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-70fbdd93-8d04-42a6-ac04-2e7396444724 tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] Action: 'create', calling method: .version_select at 0x7f1806b5c1f0>, body: {"snapshot": {"volume_id": "99280eab-183e-451a-87de-45e913e4143a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1854018511"}} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:28:29.240751 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-70fbdd93-8d04-42a6-ac04-2e7396444724 tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] 10.222.0.33 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.646986 Jun 30 18:28:29.250209 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 2/5] 10.222.0.33 () {60 vars in 1161 bytes} [Thu Jun 30 18:28:28 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:28:29.253281 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-6631efcd-f330-4844-ae0f-407c15737e48 tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] Calling method '.version_select at 0x7f1806b1e9d0>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:29.314275 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-6631efcd-f330-4844-ae0f-407c15737e48 tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/d6377b39-6900-4919-8754-6de8a0a47fd3" status: 200 len: 287 microversion: 2.1 time: 0.065361 Jun 30 18:28:29.315013 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 4/6] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 30 18:28:29 2022] GET /compute/v2.1/os-snapshots/d6377b39-6900-4919-8754-6de8a0a47fd3 => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:28:29.325415 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-9ab6570d-c2e9-49e5-8978-23f154de7f4c tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] Calling method '.version_select at 0x7f1806b5ca60>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:29.418708 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-9ab6570d-c2e9-49e5-8978-23f154de7f4c tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.097832 Jun 30 18:28:29.422688 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 3/7] 10.222.0.33 () {58 vars in 1139 bytes} [Thu Jun 30 18:28:29 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:28:29.431127 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-6d73f140-5637-4542-8f5c-9f2b5e64a20b tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] Calling method '.version_select at 0x7f1806b27160>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:29.480646 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-6d73f140-5637-4542-8f5c-9f2b5e64a20b tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/d6377b39-6900-4919-8754-6de8a0a47fd3" status: 200 len: 287 microversion: 2.1 time: 0.053689 Jun 30 18:28:29.481637 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 5/8] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 30 18:28:29 2022] GET /compute/v2.1/os-snapshots/d6377b39-6900-4919-8754-6de8a0a47fd3 => generated 287 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:28:29.827382 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-4466dbdb-1c3c-43a8-94c5-137aef0f4303 tempest-VolumesTestJSON-42413476 tempest-VolumesTestJSON-42413476-project] Calling method '.version_select at 0x7f1806b5cee0>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:29.898697 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-4466dbdb-1c3c-43a8-94c5-137aef0f4303 tempest-VolumesTestJSON-42413476 tempest-VolumesTestJSON-42413476-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/9d305239-772e-45f7-a7e3-26928b2744f5" status: 200 len: 350 microversion: 2.1 time: 0.077847 Jun 30 18:28:29.899701 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 4/9] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 30 18:28:29 2022] GET /compute/v2.1/os-volumes/9d305239-772e-45f7-a7e3-26928b2744f5 => generated 350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:28:30.495681 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-f3f383b4-b7a9-4d87-9673-f353215bf74e tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] Calling method '.version_select at 0x7f1806b1eca0>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:30.559497 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-f3f383b4-b7a9-4d87-9673-f353215bf74e tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/d6377b39-6900-4919-8754-6de8a0a47fd3" status: 200 len: 287 microversion: 2.1 time: 0.069213 Jun 30 18:28:30.563811 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 6/10] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 30 18:28:30 2022] GET /compute/v2.1/os-snapshots/d6377b39-6900-4919-8754-6de8a0a47fd3 => generated 287 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:28:31.506425 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-994d26f1-14d6-4125-b1fa-d75d06e14b44 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1921780980", "imageRef": "636d6d52-5033-47e1-bf75-0b4fc50c0bb0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:28:31.572657 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-fc72f084-8337-4681-86ea-14c6f00b4234 tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] Calling method '.version_select at 0x7f1806b1e310>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:31.617782 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-fc72f084-8337-4681-86ea-14c6f00b4234 tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/d6377b39-6900-4919-8754-6de8a0a47fd3" status: 200 len: 287 microversion: 2.1 time: 0.049644 Jun 30 18:28:31.619624 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 7/11] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 30 18:28:31 2022] GET /compute/v2.1/os-snapshots/d6377b39-6900-4919-8754-6de8a0a47fd3 => generated 287 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:28:31.739790 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.network.neutron [None req-994d26f1-14d6-4125-b1fa-d75d06e14b44 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] validate_networks() for [('2d22caf1-f6f9-42ca-8270-c3e0450297eb', None, None, None, None, None)] {{(pid=117941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 18:28:32.630206 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-384dd051-f569-4266-84cb-0e362f9a610f tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] Calling method '.version_select at 0x7f1806b27670>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:32.681016 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-384dd051-f569-4266-84cb-0e362f9a610f tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/d6377b39-6900-4919-8754-6de8a0a47fd3" status: 200 len: 287 microversion: 2.1 time: 0.054344 Jun 30 18:28:32.681604 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 8/12] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 30 18:28:32 2022] GET /compute/v2.1/os-snapshots/d6377b39-6900-4919-8754-6de8a0a47fd3 => generated 287 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:28:32.972964 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.virt.hardware [None req-994d26f1-14d6-4125-b1fa-d75d06e14b44 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Flavor limits 0:0:0 {{(pid=117941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 18:28:32.973527 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.virt.hardware [None req-994d26f1-14d6-4125-b1fa-d75d06e14b44 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Image limits 0:0:0 {{(pid=117941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 18:28:32.975141 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.virt.hardware [None req-994d26f1-14d6-4125-b1fa-d75d06e14b44 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Flavor pref 0:0:0 {{(pid=117941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 18:28:32.975831 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.virt.hardware [None req-994d26f1-14d6-4125-b1fa-d75d06e14b44 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Image pref 0:0:0 {{(pid=117941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 18:28:32.976469 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.virt.hardware [None req-994d26f1-14d6-4125-b1fa-d75d06e14b44 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 18:28:32.998255 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-994d26f1-14d6-4125-b1fa-d75d06e14b44 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:32.998952 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-994d26f1-14d6-4125-b1fa-d75d06e14b44 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:32.999756 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-994d26f1-14d6-4125-b1fa-d75d06e14b44 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:33.000189 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-994d26f1-14d6-4125-b1fa-d75d06e14b44 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:33.040191 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.quota [None req-994d26f1-14d6-4125-b1fa-d75d06e14b44 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Getting quotas for project 89156f1867314be89e5108d5506b83a3. Resources: {'ram', 'instances', 'cores'} {{(pid=117941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 18:28:33.048432 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.quota [None req-994d26f1-14d6-4125-b1fa-d75d06e14b44 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Getting quotas for user c66efdb1cc27467d85831617590c8b28 and project 89156f1867314be89e5108d5506b83a3. Resources: {'ram', 'instances', 'cores'} {{(pid=117941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 18:28:33.062748 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-994d26f1-14d6-4125-b1fa-d75d06e14b44 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Going to run 1 instances... {{(pid=117941) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 18:28:33.065561 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-994d26f1-14d6-4125-b1fa-d75d06e14b44 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: d6c61f3b-a138-4d3c-971d-8f25d3124178] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='636d6d52-5033-47e1-bf75-0b4fc50c0bb0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 18:28:33.191325 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-994d26f1-14d6-4125-b1fa-d75d06e14b44 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.759880 Jun 30 18:28:33.192201 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 5/13] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 30 18:28:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 1761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 30 18:28:33.203322 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-01f5e6a1-0713-482a-a22c-05666104069e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:33.204358 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-01f5e6a1-0713-482a-a22c-05666104069e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: d6c61f3b-a138-4d3c-971d-8f25d3124178] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:33.417751 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-01f5e6a1-0713-482a-a22c-05666104069e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:33.445177 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-01f5e6a1-0713-482a-a22c-05666104069e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178" status: 200 len: 1222 microversion: 2.1 time: 0.246258 Jun 30 18:28:33.449885 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 9/14] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:28:33 2022] GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178 => generated 1222 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:28:33.545440 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-7362266c-d310-4d98-99ad-b8cbe2bcd465 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-497428637", "imageRef": "636d6d52-5033-47e1-bf75-0b4fc50c0bb0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:28:33.637993 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.network.neutron [None req-7362266c-d310-4d98-99ad-b8cbe2bcd465 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] validate_networks() for [('2d22caf1-f6f9-42ca-8270-c3e0450297eb', None, None, None, None, None)] {{(pid=117941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 18:28:33.693027 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-4bccdeec-4a82-4055-942b-dd006e26094f tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] Calling method '.version_select at 0x7f1806b27280>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:33.745446 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-4bccdeec-4a82-4055-942b-dd006e26094f tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/d6377b39-6900-4919-8754-6de8a0a47fd3" status: 200 len: 287 microversion: 2.1 time: 0.056862 Jun 30 18:28:33.746054 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 10/15] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 30 18:28:33 2022] GET /compute/v2.1/os-snapshots/d6377b39-6900-4919-8754-6de8a0a47fd3 => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:28:34.320722 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.virt.hardware [None req-7362266c-d310-4d98-99ad-b8cbe2bcd465 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Flavor limits 0:0:0 {{(pid=117941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 18:28:34.321271 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.virt.hardware [None req-7362266c-d310-4d98-99ad-b8cbe2bcd465 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Image limits 0:0:0 {{(pid=117941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 18:28:34.322794 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.virt.hardware [None req-7362266c-d310-4d98-99ad-b8cbe2bcd465 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Flavor pref 0:0:0 {{(pid=117941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 18:28:34.323227 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.virt.hardware [None req-7362266c-d310-4d98-99ad-b8cbe2bcd465 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Image pref 0:0:0 {{(pid=117941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 18:28:34.323641 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.virt.hardware [None req-7362266c-d310-4d98-99ad-b8cbe2bcd465 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 18:28:34.335476 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7362266c-d310-4d98-99ad-b8cbe2bcd465 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:34.336549 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7362266c-d310-4d98-99ad-b8cbe2bcd465 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:34.337356 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7362266c-d310-4d98-99ad-b8cbe2bcd465 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:34.337875 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7362266c-d310-4d98-99ad-b8cbe2bcd465 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:34.366354 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.quota [None req-7362266c-d310-4d98-99ad-b8cbe2bcd465 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Getting quotas for project 89156f1867314be89e5108d5506b83a3. Resources: {'ram', 'instances', 'cores'} {{(pid=117941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 18:28:34.379916 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.quota [None req-7362266c-d310-4d98-99ad-b8cbe2bcd465 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Getting quotas for user c66efdb1cc27467d85831617590c8b28 and project 89156f1867314be89e5108d5506b83a3. Resources: {'ram', 'instances', 'cores'} {{(pid=117941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 18:28:34.404330 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-7362266c-d310-4d98-99ad-b8cbe2bcd465 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Going to run 1 instances... {{(pid=117941) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 18:28:34.406885 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-7362266c-d310-4d98-99ad-b8cbe2bcd465 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='636d6d52-5033-47e1-bf75-0b4fc50c0bb0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 18:28:34.460894 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-d5c408e7-3c7d-4b18-9238-dfb8b72e723e tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-232463967", "imageRef": "636d6d52-5033-47e1-bf75-0b4fc50c0bb0", "flavorRef": "452", "networks": [{"uuid": "af491941-578d-45af-8858-d70f6c727f67"}]}} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:28:34.497400 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-7362266c-d310-4d98-99ad-b8cbe2bcd465 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.957801 Jun 30 18:28:34.503475 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 6/16] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 30 18:28:33 2022] POST /compute/v2.1/servers => generated 383 bytes in 965 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 18:28:34.508305 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-7b95b697-3d9b-4c92-9530-d47be54dd982 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:34.508925 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-7b95b697-3d9b-4c92-9530-d47be54dd982 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:34.677353 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-7b95b697-3d9b-4c92-9530-d47be54dd982 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:34.679850 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.network.neutron [None req-d5c408e7-3c7d-4b18-9238-dfb8b72e723e tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] validate_networks() for [('af491941-578d-45af-8858-d70f6c727f67', None, None, None, None, None)] {{(pid=117940) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 18:28:34.717108 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-7b95b697-3d9b-4c92-9530-d47be54dd982 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1221 microversion: 2.1 time: 0.205501 Jun 30 18:28:34.717798 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 7/17] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:28:34 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1221 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:28:34.879230 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-6b885b94-624e-4020-8939-be94be9b77d3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Action: 'create', calling method: .version_select at 0x7f18059d33a0>, body: {"keypair": {"name": "tempest-keypair-1538822077", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZp/adSfqpAKNYQnhCD/fnsMp3mCLLypGN2r4lOiDKhXludrH5u0SR8GSUIcTazo0bsPDkUHNcEBBxWAD0LpyspTsg6d2vcsi1RvwY3okDShVHIWAydHulIyXHLfc75hg=="}} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:28:34.959707 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.quota [None req-6b885b94-624e-4020-8939-be94be9b77d3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Getting quotas for project f643222ab6194191979d2e884f5ed75a. Resources: {'key_pairs'} {{(pid=117941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 18:28:34.971081 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.quota [None req-6b885b94-624e-4020-8939-be94be9b77d3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Getting quotas for user f13e9e1bf5084d08919845767c70c3f7 and project f643222ab6194191979d2e884f5ed75a. Resources: {'key_pairs'} {{(pid=117941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 18:28:35.100003 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-6b885b94-624e-4020-8939-be94be9b77d3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.380832 Jun 30 18:28:35.107574 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 8/18] 10.222.0.33 () {62 vars in 1199 bytes} [Thu Jun 30 18:28:34 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 383 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 30 18:28:35.123853 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-b66998f6-5566-435b-9f21-e45a3465b6dc tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] Calling method '.version_select at 0x7f18059e8700>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:35.184262 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-b66998f6-5566-435b-9f21-e45a3465b6dc tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/d6377b39-6900-4919-8754-6de8a0a47fd3" status: 200 len: 287 microversion: 2.1 time: 0.065925 Jun 30 18:28:35.194942 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 9/19] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 30 18:28:35 2022] GET /compute/v2.1/os-snapshots/d6377b39-6900-4919-8754-6de8a0a47fd3 => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:28:35.735925 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-af782d16-39ed-41b5-b73f-508a7cb7ef87 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:35.736742 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-af782d16-39ed-41b5-b73f-508a7cb7ef87 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:35.980790 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-af782d16-39ed-41b5-b73f-508a7cb7ef87 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:35.994951 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-af782d16-39ed-41b5-b73f-508a7cb7ef87 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1221 microversion: 2.1 time: 0.263728 Jun 30 18:28:36.008725 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 10/20] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:28:35 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1221 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:28:36.142755 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-d5c408e7-3c7d-4b18-9238-dfb8b72e723e tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Flavor limits 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 18:28:36.143911 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-d5c408e7-3c7d-4b18-9238-dfb8b72e723e tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Image limits 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 18:28:36.144627 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-d5c408e7-3c7d-4b18-9238-dfb8b72e723e tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Flavor pref 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 18:28:36.145320 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-d5c408e7-3c7d-4b18-9238-dfb8b72e723e tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Image pref 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 18:28:36.148218 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-d5c408e7-3c7d-4b18-9238-dfb8b72e723e tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 18:28:36.178775 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d5c408e7-3c7d-4b18-9238-dfb8b72e723e tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:36.179836 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d5c408e7-3c7d-4b18-9238-dfb8b72e723e tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:36.182691 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d5c408e7-3c7d-4b18-9238-dfb8b72e723e tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:36.183495 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d5c408e7-3c7d-4b18-9238-dfb8b72e723e tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:36.196576 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-71c303b0-e945-4486-9098-a2f24a9a2d5b tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] Calling method '.version_select at 0x7f180517cc10>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:36.251519 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-71c303b0-e945-4486-9098-a2f24a9a2d5b tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/d6377b39-6900-4919-8754-6de8a0a47fd3" status: 200 len: 287 microversion: 2.1 time: 0.058941 Jun 30 18:28:36.252362 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 11/21] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 30 18:28:36 2022] GET /compute/v2.1/os-snapshots/d6377b39-6900-4919-8754-6de8a0a47fd3 => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:28:36.279191 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.quota [None req-d5c408e7-3c7d-4b18-9238-dfb8b72e723e tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Getting quotas for project e96b506102ab4528956023c5e0f3dbcf. Resources: {'ram', 'instances', 'cores'} {{(pid=117940) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 18:28:36.303650 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.quota [None req-d5c408e7-3c7d-4b18-9238-dfb8b72e723e tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Getting quotas for user db9762ad11e24246aefe2905eafe83f1 and project e96b506102ab4528956023c5e0f3dbcf. Resources: {'ram', 'instances', 'cores'} {{(pid=117940) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 18:28:36.338140 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-d5c408e7-3c7d-4b18-9238-dfb8b72e723e tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Going to run 1 instances... {{(pid=117940) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 18:28:36.356531 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-d5c408e7-3c7d-4b18-9238-dfb8b72e723e tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='636d6d52-5033-47e1-bf75-0b4fc50c0bb0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117940) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 18:28:36.574334 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-d5c408e7-3c7d-4b18-9238-dfb8b72e723e tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.199846 Jun 30 18:28:36.575616 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 11/22] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 30 18:28:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2202 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 18:28:36.587302 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-8916aa7b-63c8-4a85-bea1-253c4953fa4b tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:36.588332 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-8916aa7b-63c8-4a85-bea1-253c4953fa4b tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:37.033467 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-7f9d0c5a-86ae-4891-bdc5-4ac81aa8d0ec tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:37.034302 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-7f9d0c5a-86ae-4891-bdc5-4ac81aa8d0ec tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:37.052520 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7f9d0c5a-86ae-4891-bdc5-4ac81aa8d0ec tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:37.057480 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7f9d0c5a-86ae-4891-bdc5-4ac81aa8d0ec tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:37.058958 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7f9d0c5a-86ae-4891-bdc5-4ac81aa8d0ec tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:37.078686 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7f9d0c5a-86ae-4891-bdc5-4ac81aa8d0ec tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:37.113991 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-8916aa7b-63c8-4a85-bea1-253c4953fa4b tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9762ad11e24246aefe2905eafe83f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96b506102ab4528956023c5e0f3dbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:37.128833 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-8916aa7b-63c8-4a85-bea1-253c4953fa4b tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 200 len: 1214 microversion: 2.1 time: 0.547169 Jun 30 18:28:37.133074 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 12/23] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:28:36 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 1214 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:28:37.270285 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-ae3ff54e-da1a-4544-8dfb-232e3e1e5d4b tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] Calling method '.version_select at 0x7f18059e8dc0>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:37.375801 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-ae3ff54e-da1a-4544-8dfb-232e3e1e5d4b tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/d6377b39-6900-4919-8754-6de8a0a47fd3" status: 200 len: 287 microversion: 2.1 time: 0.116210 Jun 30 18:28:37.380372 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 13/24] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 30 18:28:37 2022] GET /compute/v2.1/os-snapshots/d6377b39-6900-4919-8754-6de8a0a47fd3 => generated 287 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:28:37.522389 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-7f9d0c5a-86ae-4891-bdc5-4ac81aa8d0ec tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:37.552053 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-7f9d0c5a-86ae-4891-bdc5-4ac81aa8d0ec tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1225 microversion: 2.1 time: 0.524350 Jun 30 18:28:37.553091 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 12/25] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:28:37 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1225 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:28:38.149743 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-b113c6b9-a08c-4cd1-8ed8-e28f5cd41efb tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:38.150568 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-b113c6b9-a08c-4cd1-8ed8-e28f5cd41efb tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:38.173630 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b113c6b9-a08c-4cd1-8ed8-e28f5cd41efb tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:38.174393 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b113c6b9-a08c-4cd1-8ed8-e28f5cd41efb tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:38.175493 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b113c6b9-a08c-4cd1-8ed8-e28f5cd41efb tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:38.176069 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b113c6b9-a08c-4cd1-8ed8-e28f5cd41efb tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:38.388409 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-1f03205d-292e-45e3-9228-1231c3c7e24e tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] Calling method '.version_select at 0x7f180594fa60>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:38.442054 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-1f03205d-292e-45e3-9228-1231c3c7e24e tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/d6377b39-6900-4919-8754-6de8a0a47fd3" status: 200 len: 287 microversion: 2.1 time: 0.057575 Jun 30 18:28:38.446634 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 13/26] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 30 18:28:38 2022] GET /compute/v2.1/os-snapshots/d6377b39-6900-4919-8754-6de8a0a47fd3 => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:28:38.496805 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-b113c6b9-a08c-4cd1-8ed8-e28f5cd41efb tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9762ad11e24246aefe2905eafe83f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96b506102ab4528956023c5e0f3dbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:38.544800 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-b113c6b9-a08c-4cd1-8ed8-e28f5cd41efb tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 200 len: 1218 microversion: 2.1 time: 0.398458 Jun 30 18:28:38.557427 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 14/27] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:28:38 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 1218 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:28:38.572465 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-ef6d26f6-4550-4094-aa97-5206479f4932 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:38.573645 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-ef6d26f6-4550-4094-aa97-5206479f4932 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:38.585145 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ef6d26f6-4550-4094-aa97-5206479f4932 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:38.585690 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ef6d26f6-4550-4094-aa97-5206479f4932 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:38.586618 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ef6d26f6-4550-4094-aa97-5206479f4932 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:38.587124 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ef6d26f6-4550-4094-aa97-5206479f4932 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:38.731258 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-ef6d26f6-4550-4094-aa97-5206479f4932 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:38.740517 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-ef6d26f6-4550-4094-aa97-5206479f4932 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1225 microversion: 2.1 time: 0.174488 Jun 30 18:28:38.741122 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 14/28] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:28:38 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1225 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:28:38.971088 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-fc2fda18-afad-4bd9-8726-14f60c8b7cd0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1803963799", "imageRef": "636d6d52-5033-47e1-bf75-0b4fc50c0bb0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e55638a8-911c-429f-af75-dce85c8efa6d"}], "security_groups": [{"name": "tempest-securitygroup--122566181"}], "key_name": "tempest-keypair-1538822077", "user_data": "}} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:28:39.104240 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.network.neutron [None req-fc2fda18-afad-4bd9-8726-14f60c8b7cd0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] validate_networks() for [('e55638a8-911c-429f-af75-dce85c8efa6d', None, None, None, None, None)] {{(pid=117941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 18:28:39.453852 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-3db76cbd-8fe3-4f06-9d97-84b8a736bb9c tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] Calling method '.version_select at 0x7f18059624c0>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:39.500828 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-3db76cbd-8fe3-4f06-9d97-84b8a736bb9c tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/d6377b39-6900-4919-8754-6de8a0a47fd3" status: 200 len: 287 microversion: 2.1 time: 0.050680 Jun 30 18:28:39.507813 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 15/29] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 30 18:28:39 2022] GET /compute/v2.1/os-snapshots/d6377b39-6900-4919-8754-6de8a0a47fd3 => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:28:39.564495 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-127cf374-eac6-4944-bf71-7b192358dcd0 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:39.565309 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-127cf374-eac6-4944-bf71-7b192358dcd0 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:39.575506 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-127cf374-eac6-4944-bf71-7b192358dcd0 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:39.578577 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-127cf374-eac6-4944-bf71-7b192358dcd0 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:39.579624 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-127cf374-eac6-4944-bf71-7b192358dcd0 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:39.580272 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.virt.hardware [None req-fc2fda18-afad-4bd9-8726-14f60c8b7cd0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Flavor limits 0:0:0 {{(pid=117941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 18:28:39.582612 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.virt.hardware [None req-fc2fda18-afad-4bd9-8726-14f60c8b7cd0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Image limits 0:0:0 {{(pid=117941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 18:28:39.584306 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-127cf374-eac6-4944-bf71-7b192358dcd0 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:39.587523 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.virt.hardware [None req-fc2fda18-afad-4bd9-8726-14f60c8b7cd0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Flavor pref 0:0:0 {{(pid=117941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 18:28:39.588519 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.virt.hardware [None req-fc2fda18-afad-4bd9-8726-14f60c8b7cd0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Image pref 0:0:0 {{(pid=117941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 18:28:39.589252 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.virt.hardware [None req-fc2fda18-afad-4bd9-8726-14f60c8b7cd0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 18:28:39.601702 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fc2fda18-afad-4bd9-8726-14f60c8b7cd0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:39.602978 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fc2fda18-afad-4bd9-8726-14f60c8b7cd0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:39.604940 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fc2fda18-afad-4bd9-8726-14f60c8b7cd0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:39.605564 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fc2fda18-afad-4bd9-8726-14f60c8b7cd0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:39.628495 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.quota [None req-fc2fda18-afad-4bd9-8726-14f60c8b7cd0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Getting quotas for project f643222ab6194191979d2e884f5ed75a. Resources: {'ram', 'instances', 'cores'} {{(pid=117941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 18:28:39.633146 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.quota [None req-fc2fda18-afad-4bd9-8726-14f60c8b7cd0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Getting quotas for user f13e9e1bf5084d08919845767c70c3f7 and project f643222ab6194191979d2e884f5ed75a. Resources: {'ram', 'instances', 'cores'} {{(pid=117941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 18:28:39.648650 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-fc2fda18-afad-4bd9-8726-14f60c8b7cd0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Going to run 1 instances... {{(pid=117941) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 18:28:39.654370 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-fc2fda18-afad-4bd9-8726-14f60c8b7cd0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='636d6d52-5033-47e1-bf75-0b4fc50c0bb0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 18:28:39.719643 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-127cf374-eac6-4944-bf71-7b192358dcd0 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9762ad11e24246aefe2905eafe83f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96b506102ab4528956023c5e0f3dbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:39.732237 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-127cf374-eac6-4944-bf71-7b192358dcd0 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 200 len: 1218 microversion: 2.1 time: 0.168287 Jun 30 18:28:39.733126 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 16/30] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:28:39 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 1218 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:28:39.756953 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-fc2fda18-afad-4bd9-8726-14f60c8b7cd0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.790702 Jun 30 18:28:39.758464 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 15/31] 10.222.0.33 () {62 vars in 1187 bytes} [Thu Jun 30 18:28:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 30 18:28:39.758844 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-f03e2cbb-08ce-409f-bcfe-f8e7c8e22776 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:39.759702 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-f03e2cbb-08ce-409f-bcfe-f8e7c8e22776 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:39.770695 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-7bee8037-37cc-4906-b890-8a3df784a705 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:39.771781 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-7bee8037-37cc-4906-b890-8a3df784a705 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:39.773505 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f03e2cbb-08ce-409f-bcfe-f8e7c8e22776 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:39.774011 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f03e2cbb-08ce-409f-bcfe-f8e7c8e22776 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:39.774781 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f03e2cbb-08ce-409f-bcfe-f8e7c8e22776 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:39.776008 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f03e2cbb-08ce-409f-bcfe-f8e7c8e22776 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:39.845428 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-7bee8037-37cc-4906-b890-8a3df784a705 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:39.856113 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-7bee8037-37cc-4906-b890-8a3df784a705 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:39.860175 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-7bee8037-37cc-4906-b890-8a3df784a705 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:39.862532 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-7bee8037-37cc-4906-b890-8a3df784a705 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1282 microversion: 2.20 time: 0.097311 Jun 30 18:28:39.878582 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 16/32] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:28:39 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1282 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:28:39.937100 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-f03e2cbb-08ce-409f-bcfe-f8e7c8e22776 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:39.948519 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-f03e2cbb-08ce-409f-bcfe-f8e7c8e22776 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1217 microversion: 2.1 time: 0.194667 Jun 30 18:28:39.952797 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 17/33] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:28:39 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1217 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:28:40.524196 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-c92bdfeb-e662-47ff-9bc3-f226d29dcbc5 tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] Calling method '.version_select at 0x7f18050c8040>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:40.572188 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-c92bdfeb-e662-47ff-9bc3-f226d29dcbc5 tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/d6377b39-6900-4919-8754-6de8a0a47fd3" status: 200 len: 288 microversion: 2.1 time: 0.060542 Jun 30 18:28:40.578071 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 17/34] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 30 18:28:40 2022] GET /compute/v2.1/os-snapshots/d6377b39-6900-4919-8754-6de8a0a47fd3 => generated 288 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:28:40.584616 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-df6d92db-84c8-42cd-8d93-bccdaa30ee50 tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] Calling method '.version_select at 0x7f1805977160>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:40.691772 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-df6d92db-84c8-42cd-8d93-bccdaa30ee50 tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] 10.222.0.33 "DELETE /compute/v2.1/os-snapshots/d6377b39-6900-4919-8754-6de8a0a47fd3" status: 202 len: 0 microversion: 2.1 time: 0.111807 Jun 30 18:28:40.692358 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 18/35] 10.222.0.33 () {58 vars in 1253 bytes} [Thu Jun 30 18:28:40 2022] DELETE /compute/v2.1/os-snapshots/d6377b39-6900-4919-8754-6de8a0a47fd3 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 18:28:40.700829 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-04bd05ea-a148-4f2f-bb84-c3eb3244759b tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] Calling method '.version_select at 0x7f1805126e50>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:40.747548 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-04bd05ea-a148-4f2f-bb84-c3eb3244759b tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/d6377b39-6900-4919-8754-6de8a0a47fd3" status: 200 len: 287 microversion: 2.1 time: 0.045725 Jun 30 18:28:40.747548 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 18/36] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 30 18:28:40 2022] GET /compute/v2.1/os-snapshots/d6377b39-6900-4919-8754-6de8a0a47fd3 => generated 287 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:28:40.749458 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-93c0f631-ed6a-4507-abaf-428b60f5ff1f tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:40.750228 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-93c0f631-ed6a-4507-abaf-428b60f5ff1f tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:40.765316 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-93c0f631-ed6a-4507-abaf-428b60f5ff1f tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:40.765869 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-93c0f631-ed6a-4507-abaf-428b60f5ff1f tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:40.766771 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-93c0f631-ed6a-4507-abaf-428b60f5ff1f tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:40.767283 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-93c0f631-ed6a-4507-abaf-428b60f5ff1f tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:40.872521 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-93c0f631-ed6a-4507-abaf-428b60f5ff1f tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9762ad11e24246aefe2905eafe83f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96b506102ab4528956023c5e0f3dbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:40.881197 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-93c0f631-ed6a-4507-abaf-428b60f5ff1f tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 200 len: 1266 microversion: 2.1 time: 0.135894 Jun 30 18:28:40.882190 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 19/37] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:28:40 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:28:40.886336 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-578995c0-955e-4e2d-8bf9-04b93df53c2b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:40.886957 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-578995c0-955e-4e2d-8bf9-04b93df53c2b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:40.893352 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-578995c0-955e-4e2d-8bf9-04b93df53c2b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:40.893846 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-578995c0-955e-4e2d-8bf9-04b93df53c2b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:40.894617 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-578995c0-955e-4e2d-8bf9-04b93df53c2b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:40.895055 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-578995c0-955e-4e2d-8bf9-04b93df53c2b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:40.957900 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-578995c0-955e-4e2d-8bf9-04b93df53c2b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:40.965427 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-b9da793b-c085-4d1b-a975-2e9d295f0f66 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:40.966065 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-b9da793b-c085-4d1b-a975-2e9d295f0f66 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:40.976184 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-578995c0-955e-4e2d-8bf9-04b93df53c2b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:40.980030 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-578995c0-955e-4e2d-8bf9-04b93df53c2b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:40.981173 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-578995c0-955e-4e2d-8bf9-04b93df53c2b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1286 microversion: 2.20 time: 0.099354 Jun 30 18:28:40.983415 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b9da793b-c085-4d1b-a975-2e9d295f0f66 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:40.983869 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b9da793b-c085-4d1b-a975-2e9d295f0f66 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:40.984838 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b9da793b-c085-4d1b-a975-2e9d295f0f66 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:40.985273 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b9da793b-c085-4d1b-a975-2e9d295f0f66 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:40.989892 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 19/38] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:28:40 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1286 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 18:28:41.072574 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-b9da793b-c085-4d1b-a975-2e9d295f0f66 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:41.082771 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-b9da793b-c085-4d1b-a975-2e9d295f0f66 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1281 microversion: 2.1 time: 0.121383 Jun 30 18:28:41.084502 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 20/39] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:28:40 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1281 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:28:41.755193 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-83d6f097-66fb-4479-a24c-21692cd282c7 tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] Calling method '.version_select at 0x7f1805104af0>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:41.785599 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-83d6f097-66fb-4479-a24c-21692cd282c7 tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/d6377b39-6900-4919-8754-6de8a0a47fd3" status: 200 len: 287 microversion: 2.1 time: 0.034161 Jun 30 18:28:41.786177 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 20/40] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 30 18:28:41 2022] GET /compute/v2.1/os-snapshots/d6377b39-6900-4919-8754-6de8a0a47fd3 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:28:41.902393 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-5a3e58bd-278c-4c1f-a594-524983dee277 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:41.903171 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-5a3e58bd-278c-4c1f-a594-524983dee277 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:41.910745 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5a3e58bd-278c-4c1f-a594-524983dee277 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:41.911430 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5a3e58bd-278c-4c1f-a594-524983dee277 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:41.912207 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5a3e58bd-278c-4c1f-a594-524983dee277 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:41.912786 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5a3e58bd-278c-4c1f-a594-524983dee277 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:41.982503 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-5a3e58bd-278c-4c1f-a594-524983dee277 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9762ad11e24246aefe2905eafe83f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96b506102ab4528956023c5e0f3dbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:41.989913 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-5a3e58bd-278c-4c1f-a594-524983dee277 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 200 len: 1266 microversion: 2.1 time: 0.095281 Jun 30 18:28:41.990502 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 21/41] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:28:41 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 1266 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:28:42.006540 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-c705a7cb-a442-45d8-918d-cc2db8547664 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:42.007150 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-c705a7cb-a442-45d8-918d-cc2db8547664 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:42.013373 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c705a7cb-a442-45d8-918d-cc2db8547664 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:42.013862 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c705a7cb-a442-45d8-918d-cc2db8547664 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:42.014623 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c705a7cb-a442-45d8-918d-cc2db8547664 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:42.015056 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c705a7cb-a442-45d8-918d-cc2db8547664 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:42.078039 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-c705a7cb-a442-45d8-918d-cc2db8547664 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:42.086282 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-c705a7cb-a442-45d8-918d-cc2db8547664 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:42.088399 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-c705a7cb-a442-45d8-918d-cc2db8547664 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:42.089548 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-c705a7cb-a442-45d8-918d-cc2db8547664 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1286 microversion: 2.20 time: 0.086864 Jun 30 18:28:42.090120 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 21/42] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:28:42 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:28:42.100047 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-0506679d-7618-42f3-814f-245e28804e08 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:42.100656 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-0506679d-7618-42f3-814f-245e28804e08 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:42.107291 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0506679d-7618-42f3-814f-245e28804e08 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:42.107733 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0506679d-7618-42f3-814f-245e28804e08 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:42.108485 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0506679d-7618-42f3-814f-245e28804e08 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:42.108913 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0506679d-7618-42f3-814f-245e28804e08 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:42.171571 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-0506679d-7618-42f3-814f-245e28804e08 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:42.178784 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-0506679d-7618-42f3-814f-245e28804e08 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1281 microversion: 2.1 time: 0.082576 Jun 30 18:28:42.179339 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 22/43] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:28:42 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1281 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:28:42.798172 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-1a0b68b7-e282-4858-84d7-018e3c969d06 tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] Calling method '.version_select at 0x7f1805126c10>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:42.832093 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-1a0b68b7-e282-4858-84d7-018e3c969d06 tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/d6377b39-6900-4919-8754-6de8a0a47fd3" status: 200 len: 287 microversion: 2.1 time: 0.037862 Jun 30 18:28:42.832824 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 22/44] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 30 18:28:42 2022] GET /compute/v2.1/os-snapshots/d6377b39-6900-4919-8754-6de8a0a47fd3 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:28:43.007355 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-34fff764-656f-4a37-a5f5-bfdc85f7bd15 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:43.008066 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-34fff764-656f-4a37-a5f5-bfdc85f7bd15 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:43.014707 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-34fff764-656f-4a37-a5f5-bfdc85f7bd15 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:43.015153 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-34fff764-656f-4a37-a5f5-bfdc85f7bd15 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:43.015907 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-34fff764-656f-4a37-a5f5-bfdc85f7bd15 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:43.016334 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-34fff764-656f-4a37-a5f5-bfdc85f7bd15 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:43.079791 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-34fff764-656f-4a37-a5f5-bfdc85f7bd15 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9762ad11e24246aefe2905eafe83f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96b506102ab4528956023c5e0f3dbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:43.087264 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-34fff764-656f-4a37-a5f5-bfdc85f7bd15 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 200 len: 1266 microversion: 2.1 time: 0.083773 Jun 30 18:28:43.087823 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 23/45] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:28:43 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:28:43.107706 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-239f00e5-87ca-4428-a669-8afafdb18f84 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:43.107924 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-239f00e5-87ca-4428-a669-8afafdb18f84 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:43.114188 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-239f00e5-87ca-4428-a669-8afafdb18f84 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:43.114642 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-239f00e5-87ca-4428-a669-8afafdb18f84 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:43.115406 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-239f00e5-87ca-4428-a669-8afafdb18f84 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:43.115880 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-239f00e5-87ca-4428-a669-8afafdb18f84 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:43.178271 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-239f00e5-87ca-4428-a669-8afafdb18f84 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:43.188007 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-239f00e5-87ca-4428-a669-8afafdb18f84 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:43.189518 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-239f00e5-87ca-4428-a669-8afafdb18f84 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:43.190758 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-239f00e5-87ca-4428-a669-8afafdb18f84 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1286 microversion: 2.20 time: 0.087387 Jun 30 18:28:43.191319 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 23/46] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:28:43 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:28:43.195822 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-04869045-9291-437f-b93a-e3bde349d25a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:43.196430 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-04869045-9291-437f-b93a-e3bde349d25a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:43.203999 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-04869045-9291-437f-b93a-e3bde349d25a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:43.204567 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-04869045-9291-437f-b93a-e3bde349d25a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:43.205440 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-04869045-9291-437f-b93a-e3bde349d25a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:43.206144 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-04869045-9291-437f-b93a-e3bde349d25a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:43.275055 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-04869045-9291-437f-b93a-e3bde349d25a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:43.283213 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-04869045-9291-437f-b93a-e3bde349d25a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1281 microversion: 2.1 time: 0.091377 Jun 30 18:28:43.283805 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 24/47] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:28:43 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1281 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:28:43.844228 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-300818e6-9b3d-41f6-9532-1ca826e15c65 tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] Calling method '.version_select at 0x7f1805126ca0>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:43.878267 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-300818e6-9b3d-41f6-9532-1ca826e15c65 tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/d6377b39-6900-4919-8754-6de8a0a47fd3" status: 200 len: 287 microversion: 2.1 time: 0.037787 Jun 30 18:28:43.878838 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 24/48] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 30 18:28:43 2022] GET /compute/v2.1/os-snapshots/d6377b39-6900-4919-8754-6de8a0a47fd3 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:28:44.104025 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-fe3a0e45-9065-4d65-8245-538ebcefafdd tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:44.104630 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-fe3a0e45-9065-4d65-8245-538ebcefafdd tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:44.111367 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fe3a0e45-9065-4d65-8245-538ebcefafdd tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:44.111823 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fe3a0e45-9065-4d65-8245-538ebcefafdd tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:44.112625 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fe3a0e45-9065-4d65-8245-538ebcefafdd tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:44.113067 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fe3a0e45-9065-4d65-8245-538ebcefafdd tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:44.176123 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-fe3a0e45-9065-4d65-8245-538ebcefafdd tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9762ad11e24246aefe2905eafe83f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96b506102ab4528956023c5e0f3dbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:44.187583 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-fe3a0e45-9065-4d65-8245-538ebcefafdd tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 200 len: 1266 microversion: 2.1 time: 0.087241 Jun 30 18:28:44.188177 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 25/49] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:28:44 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:28:44.210087 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-fb3474c5-8fc0-475e-99f4-23973695e5cb tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:44.210724 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-fb3474c5-8fc0-475e-99f4-23973695e5cb tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:44.217163 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fb3474c5-8fc0-475e-99f4-23973695e5cb tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:44.217647 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fb3474c5-8fc0-475e-99f4-23973695e5cb tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:44.218393 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fb3474c5-8fc0-475e-99f4-23973695e5cb tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:44.218821 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fb3474c5-8fc0-475e-99f4-23973695e5cb tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:44.286123 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-fb3474c5-8fc0-475e-99f4-23973695e5cb tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:44.300604 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-721e2caa-8b9b-41ba-96e7-85bb40ebdc0b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:44.301104 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-fb3474c5-8fc0-475e-99f4-23973695e5cb tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:44.301711 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-721e2caa-8b9b-41ba-96e7-85bb40ebdc0b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:44.302661 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-fb3474c5-8fc0-475e-99f4-23973695e5cb tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:44.303864 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-fb3474c5-8fc0-475e-99f4-23973695e5cb tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1286 microversion: 2.20 time: 0.097583 Jun 30 18:28:44.305955 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 25/50] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:28:44 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1286 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:28:44.311820 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-721e2caa-8b9b-41ba-96e7-85bb40ebdc0b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:44.312484 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-721e2caa-8b9b-41ba-96e7-85bb40ebdc0b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:44.314232 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-721e2caa-8b9b-41ba-96e7-85bb40ebdc0b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:44.315645 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-721e2caa-8b9b-41ba-96e7-85bb40ebdc0b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:44.379868 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-721e2caa-8b9b-41ba-96e7-85bb40ebdc0b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:44.387498 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-721e2caa-8b9b-41ba-96e7-85bb40ebdc0b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1281 microversion: 2.1 time: 0.090994 Jun 30 18:28:44.388123 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 26/51] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:28:44 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1281 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:28:44.890623 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-998e7866-d0b6-411b-b54f-ff44d2a8fe9d tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] Calling method '.version_select at 0x7f18050d7040>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:44.929811 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-998e7866-d0b6-411b-b54f-ff44d2a8fe9d tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/d6377b39-6900-4919-8754-6de8a0a47fd3" status: 200 len: 287 microversion: 2.1 time: 0.043288 Jun 30 18:28:44.930835 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 26/52] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 30 18:28:44 2022] GET /compute/v2.1/os-snapshots/d6377b39-6900-4919-8754-6de8a0a47fd3 => generated 287 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:28:45.205625 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-fc9bd051-9bcd-4c60-9832-6eaff302a23c tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:45.206261 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-fc9bd051-9bcd-4c60-9832-6eaff302a23c tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:45.218902 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fc9bd051-9bcd-4c60-9832-6eaff302a23c tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:45.219351 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fc9bd051-9bcd-4c60-9832-6eaff302a23c tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:45.228434 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fc9bd051-9bcd-4c60-9832-6eaff302a23c tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:45.228994 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fc9bd051-9bcd-4c60-9832-6eaff302a23c tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:45.323047 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-9e92a72e-317f-4f6f-88f2-1dba4df933ed tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:45.323658 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-9e92a72e-317f-4f6f-88f2-1dba4df933ed tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:45.333390 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9e92a72e-317f-4f6f-88f2-1dba4df933ed tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:45.339067 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9e92a72e-317f-4f6f-88f2-1dba4df933ed tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:45.345135 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9e92a72e-317f-4f6f-88f2-1dba4df933ed tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:45.346796 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9e92a72e-317f-4f6f-88f2-1dba4df933ed tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:45.485672 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-fc9bd051-9bcd-4c60-9832-6eaff302a23c tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9762ad11e24246aefe2905eafe83f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96b506102ab4528956023c5e0f3dbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:45.499942 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-fc9bd051-9bcd-4c60-9832-6eaff302a23c tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 200 len: 1272 microversion: 2.1 time: 0.299179 Jun 30 18:28:45.513884 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 27/53] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:28:45 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 1272 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:28:45.527778 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-9e92a72e-317f-4f6f-88f2-1dba4df933ed tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:45.541865 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-9e92a72e-317f-4f6f-88f2-1dba4df933ed tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:45.542476 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-73e434d4-197d-4960-b92c-f6b85883578f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:45.543362 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-9e92a72e-317f-4f6f-88f2-1dba4df933ed tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:45.545788 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-9e92a72e-317f-4f6f-88f2-1dba4df933ed tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1334 microversion: 2.20 time: 0.225839 Jun 30 18:28:45.552038 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 27/54] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:28:45 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1334 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 18:28:45.558368 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-73e434d4-197d-4960-b92c-f6b85883578f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:45.575315 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-73e434d4-197d-4960-b92c-f6b85883578f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:45.576757 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-73e434d4-197d-4960-b92c-f6b85883578f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:45.580230 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-73e434d4-197d-4960-b92c-f6b85883578f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:45.580919 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-73e434d4-197d-4960-b92c-f6b85883578f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:45.742593 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-73e434d4-197d-4960-b92c-f6b85883578f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:45.751575 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-73e434d4-197d-4960-b92c-f6b85883578f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1279 microversion: 2.1 time: 0.236240 Jun 30 18:28:45.765496 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 28/55] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:28:45 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1279 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:28:45.871694 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-6e1fa135-6b4c-4c66-89d1-0ce1fc4e341c tempest-VolumesTestJSON-42413476 tempest-VolumesTestJSON-42413476-project] Calling method '.version_select at 0x7f18050c8550>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:45.943343 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-b643c806-a7d0-42b6-8341-26592fda65ed tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] Calling method '.version_select at 0x7f18058caa60>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:45.995367 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-6e1fa135-6b4c-4c66-89d1-0ce1fc4e341c tempest-VolumesTestJSON-42413476 tempest-VolumesTestJSON-42413476-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/e33fe436-51b8-4a1a-94c2-6064985e17f4" status: 200 len: 350 microversion: 2.1 time: 0.127460 Jun 30 18:28:45.995832 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 28/56] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 30 18:28:45 2022] GET /compute/v2.1/os-volumes/e33fe436-51b8-4a1a-94c2-6064985e17f4 => generated 350 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:28:46.008288 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-74276fab-660c-4739-9680-a3363a60b6cc tempest-VolumesTestJSON-42413476 tempest-VolumesTestJSON-42413476-project] Calling method '.version_select at 0x7f18050c8ee0>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:46.071805 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.wsgi [None req-b643c806-a7d0-42b6-8341-26592fda65ed tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] HTTP exception thrown: Snapshot d6377b39-6900-4919-8754-6de8a0a47fd3 could not be found. Jun 30 18:28:46.077532 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-b643c806-a7d0-42b6-8341-26592fda65ed tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] Request method failure captured: Jun 30 18:28:46.077532 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: request: GET /compute/v2.1/os-snapshots/d6377b39-6900-4919-8754-6de8a0a47fd3 HTTP/1.1 Jun 30 18:28:46.077532 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept: application/json Jun 30 18:28:46.077532 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept-Encoding: identity Jun 30 18:28:46.077532 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Connection: close Jun 30 18:28:46.077532 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Length: 0 Jun 30 18:28:46.077532 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Type: application/json Jun 30 18:28:46.077532 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Host: 10.222.0.33 Jun 30 18:28:46.077532 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Openstack-System-Scope: None Jun 30 18:28:46.077532 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: User-Agent: python-urllib3/1.26.9 Jun 30 18:28:46.077532 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Auth-Token: gAAAAABivetFzjb3hR91tw7JUbhE2Pd-QGuGQicP2GrG013om7v98Kax326RfwZUMks8S6iER_3P59H8wzfUrFMmBBzPHz-luh9cgcidJ-MuOaqGTCiPg74TeRGpDUrmwgUFiVpDZIghkrEnLGFphMTJ7iKis4ORqmsW8xD5Ph7ZrwVpFy2o9xg Jun 30 18:28:46.077532 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Id: None Jun 30 18:28:46.077532 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Name: None Jun 30 18:28:46.077532 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Identity-Status: Confirmed Jun 30 18:28:46.077532 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Is-Admin-Project: True Jun 30 18:28:46.077532 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Id: default Jun 30 18:28:46.077532 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Name: Default Jun 30 18:28:46.077532 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Id: 6a127ed10b0a465aa487242a344defa0 Jun 30 18:28:46.077532 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1262642487 Jun 30 18:28:46.077532 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Role: reader,member Jun 30 18:28:46.077532 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Roles: reader,member Jun 30 18:28:46.078944 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6a127ed10b0a465aa487242a344defa0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6a127ed10b0a465aa487242a344defa0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6a127ed10b0a465aa487242a344defa0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6a127ed10b0a465aa487242a344defa0"}]}] Jun 30 18:28:46.078944 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1262642487 Jun 30 18:28:46.078944 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Id: 6a127ed10b0a465aa487242a344defa0 Jun 30 18:28:46.078944 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1262642487 Jun 30 18:28:46.078944 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User: tempest-VolumesSnapshotsTestJSON-1262642487-project Jun 30 18:28:46.078944 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Id: default Jun 30 18:28:46.078944 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Name: Default Jun 30 18:28:46.078944 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Id: 4f262bfdf0d54e76a77e8ce8cda137dc Jun 30 18:28:46.078944 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1262642487-project Jun 30 18:28:46.078944 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: method: Jun 30 18:28:46.078944 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: exception: Snapshot d6377b39-6900-4919-8754-6de8a0a47fd3 could not be found. Jun 30 18:28:46.078944 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: action_args: {'id': 'd6377b39-6900-4919-8754-6de8a0a47fd3'} Jun 30 18:28:46.078944 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:28:46.079788 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:28:46.079788 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 30 18:28:46.079788 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 30 18:28:46.079788 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 30 18:28:46.079788 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 30 18:28:46.079788 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 30 18:28:46.079788 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 30 18:28:46.079788 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 18:28:46.079788 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 18:28:46.079788 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 18:28:46.079788 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 18:28:46.079788 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 18:28:46.079788 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 18:28:46.079788 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 18:28:46.079788 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 18:28:46.079788 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d6377b39-6900-4919-8754-6de8a0a47fd3 could not be found. (HTTP 404) (Request-ID: req-776d0505-2fc1-490c-9af3-91c100789b64) Jun 30 18:28:46.079788 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:28:46.079788 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:28:46.080820 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:28:46.080820 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:28:46.080820 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 30 18:28:46.080820 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 30 18:28:46.080820 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 18:28:46.080820 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 18:28:46.080820 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 30 18:28:46.080820 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 30 18:28:46.080820 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 18:28:46.080820 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 18:28:46.080820 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 30 18:28:46.080820 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 30 18:28:46.080820 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 30 18:28:46.080820 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 30 18:28:46.080820 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 30 18:28:46.080820 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 30 18:28:46.080820 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 18:28:46.080820 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 18:28:46.080820 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 18:28:46.081954 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 18:28:46.081954 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 18:28:46.081954 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 18:28:46.081954 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 18:28:46.081954 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 18:28:46.081954 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d6377b39-6900-4919-8754-6de8a0a47fd3 could not be found. Jun 30 18:28:46.081954 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:28:46.081954 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:28:46.081954 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:28:46.081954 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:28:46.081954 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:28:46.081954 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:28:46.081954 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:28:46.081954 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:28:46.081954 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 18:28:46.081954 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 18:28:46.081954 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:28:46.081954 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:28:46.081954 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 30 18:28:46.081954 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:28:46.083196 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d6377b39-6900-4919-8754-6de8a0a47fd3 could not be found. Jun 30 18:28:46.083196 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:28:46.083196 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:28:46.083196 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:28:46.083196 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:28:46.083196 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:28:46.083196 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:28:46.083196 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:28:46.083196 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:28:46.083196 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d6377b39-6900-4919-8754-6de8a0a47fd3 could not be found. Jun 30 18:28:46.083196 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:28:46.083196 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-b643c806-a7d0-42b6-8341-26592fda65ed tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] Returning 404 to user: Snapshot d6377b39-6900-4919-8754-6de8a0a47fd3 could not be found. {{(pid=117940) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:28:46.083196 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-b643c806-a7d0-42b6-8341-26592fda65ed tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/d6377b39-6900-4919-8754-6de8a0a47fd3" status: 404 len: 111 microversion: 2.1 time: 0.139722 Jun 30 18:28:46.083901 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 29/57] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 30 18:28:45 2022] GET /compute/v2.1/os-snapshots/d6377b39-6900-4919-8754-6de8a0a47fd3 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:28:46.089137 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-fc9fcb65-d057-4c3c-b850-32c80d8e7d1f tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] Calling method '.version_select at 0x7f18074f8790>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:46.166629 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-74276fab-660c-4739-9680-a3363a60b6cc tempest-VolumesTestJSON-42413476 tempest-VolumesTestJSON-42413476-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.161992 Jun 30 18:28:46.167466 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 29/58] 10.222.0.33 () {58 vars in 1133 bytes} [Thu Jun 30 18:28:46 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:28:46.181657 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-5c66d25c-c86b-49f0-a2e9-f7c13f0404a0 tempest-VolumesTestJSON-42413476 tempest-VolumesTestJSON-42413476-project] Calling method '.version_select at 0x7f18050bf3a0>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:46.224629 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell0:SELECT=2 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:28:46.232885 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-fc9fcb65-d057-4c3c-b850-32c80d8e7d1f tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/99280eab-183e-451a-87de-45e913e4143a" status: 202 len: 0 microversion: 2.1 time: 0.148347 Jun 30 18:28:46.237957 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 30/59] 10.222.0.33 () {58 vars in 1247 bytes} [Thu Jun 30 18:28:46 2022] DELETE /compute/v2.1/os-volumes/99280eab-183e-451a-87de-45e913e4143a => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 18:28:46.250355 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-deb8b70d-762e-442a-b8d4-c0e02ed44a48 tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] Calling method '.version_select at 0x7f18058cab80>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:46.331679 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell0:SELECT=8 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:28:46.423714 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-deb8b70d-762e-442a-b8d4-c0e02ed44a48 tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/99280eab-183e-451a-87de-45e913e4143a" status: 200 len: 345 microversion: 2.1 time: 0.180846 Jun 30 18:28:46.424795 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 31/60] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 30 18:28:46 2022] GET /compute/v2.1/os-volumes/99280eab-183e-451a-87de-45e913e4143a => generated 345 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:28:46.493644 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-5c66d25c-c86b-49f0-a2e9-f7c13f0404a0 tempest-VolumesTestJSON-42413476 tempest-VolumesTestJSON-42413476-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.316304 Jun 30 18:28:46.494726 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 30/61] 10.222.0.33 () {58 vars in 1148 bytes} [Thu Jun 30 18:28:46 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:28:46.508652 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-c094703b-1a0f-41ed-99a0-e7be3bff01bd tempest-VolumesTestJSON-42413476 tempest-VolumesTestJSON-42413476-project] Calling method '.version_select at 0x7f18059628b0>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:46.520880 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-e4e8215f-bf67-491a-8b8a-2351f2a3272b tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:46.522123 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-e4e8215f-bf67-491a-8b8a-2351f2a3272b tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:46.543033 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e4e8215f-bf67-491a-8b8a-2351f2a3272b tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:46.544870 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e4e8215f-bf67-491a-8b8a-2351f2a3272b tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:46.562127 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e4e8215f-bf67-491a-8b8a-2351f2a3272b tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:46.564946 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e4e8215f-bf67-491a-8b8a-2351f2a3272b tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:46.735612 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-c094703b-1a0f-41ed-99a0-e7be3bff01bd tempest-VolumesTestJSON-42413476 tempest-VolumesTestJSON-42413476-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.230789 Jun 30 18:28:46.737114 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 32/62] 10.222.0.33 () {58 vars in 1133 bytes} [Thu Jun 30 18:28:46 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:28:46.743287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-c02291bd-3905-4b57-9d4d-3a5a8e80ad05 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:46.744214 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-c02291bd-3905-4b57-9d4d-3a5a8e80ad05 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:46.753379 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c02291bd-3905-4b57-9d4d-3a5a8e80ad05 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:46.754373 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c02291bd-3905-4b57-9d4d-3a5a8e80ad05 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:46.755771 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c02291bd-3905-4b57-9d4d-3a5a8e80ad05 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:46.761276 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c02291bd-3905-4b57-9d4d-3a5a8e80ad05 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:46.944315 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-c02291bd-3905-4b57-9d4d-3a5a8e80ad05 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:46.954159 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-c02291bd-3905-4b57-9d4d-3a5a8e80ad05 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:46.955683 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-c02291bd-3905-4b57-9d4d-3a5a8e80ad05 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:46.957184 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-c02291bd-3905-4b57-9d4d-3a5a8e80ad05 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1340 microversion: 2.20 time: 0.218482 Jun 30 18:28:46.957939 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 33/63] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:28:46 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1340 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:28:46.962502 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-bebc0b46-cb57-4b46-b41a-743a5eb38874 tempest-VolumesTestJSON-42413476 tempest-VolumesTestJSON-42413476-project] Calling method '.version_select at 0x7f18058ca5e0>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:47.060915 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-bebc0b46-cb57-4b46-b41a-743a5eb38874 tempest-VolumesTestJSON-42413476 tempest-VolumesTestJSON-42413476-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.101198 Jun 30 18:28:47.068509 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 34/64] 10.222.0.33 () {58 vars in 1166 bytes} [Thu Jun 30 18:28:46 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:28:47.069033 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-64b9e715-68df-4fc0-b561-1a2eae37cae7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:47.069731 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-64b9e715-68df-4fc0-b561-1a2eae37cae7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:47.077323 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-64b9e715-68df-4fc0-b561-1a2eae37cae7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:47.077773 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-64b9e715-68df-4fc0-b561-1a2eae37cae7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:47.078534 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-64b9e715-68df-4fc0-b561-1a2eae37cae7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:47.078963 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-64b9e715-68df-4fc0-b561-1a2eae37cae7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:47.195750 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-e4e8215f-bf67-491a-8b8a-2351f2a3272b tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9762ad11e24246aefe2905eafe83f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96b506102ab4528956023c5e0f3dbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:47.205722 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-e4e8215f-bf67-491a-8b8a-2351f2a3272b tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 200 len: 1314 microversion: 2.1 time: 0.691637 Jun 30 18:28:47.206814 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 31/65] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:28:46 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 1314 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:28:47.211803 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-e8508bdb-feb2-4f6e-ad57-6cb350949357 tempest-VolumesTestJSON-42413476 tempest-VolumesTestJSON-42413476-project] Calling method '.version_select at 0x7f18050bf160>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:47.241261 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-64b9e715-68df-4fc0-b561-1a2eae37cae7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:47.252116 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-64b9e715-68df-4fc0-b561-1a2eae37cae7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1279 microversion: 2.1 time: 0.188582 Jun 30 18:28:47.262246 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 35/66] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:28:47 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1279 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:28:47.350191 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [req-9cbae1e1-47f1-4a55-babb-b73c1d30a597 req-88313ce6-d8e5-40ec-91d7-72f59f981282 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6c61f3b-a138-4d3c-971d-8f25d3124178", "tag": "8c7fc4bb-044c-4951-ae37-7f1aab689075"}]} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:28:47.373179 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-9cbae1e1-47f1-4a55-babb-b73c1d30a597 req-88313ce6-d8e5-40ec-91d7-72f59f981282 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:47.373809 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-9cbae1e1-47f1-4a55-babb-b73c1d30a597 req-88313ce6-d8e5-40ec-91d7-72f59f981282 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:47.398728 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell1:SELECT=100 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:28:47.401137 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.compute.server_external_events [req-9cbae1e1-47f1-4a55-babb-b73c1d30a597 req-88313ce6-d8e5-40ec-91d7-72f59f981282 service nova] Creating event network-changed:8c7fc4bb-044c-4951-ae37-7f1aab689075 for instance d6c61f3b-a138-4d3c-971d-8f25d3124178 on hv-cinder-80378 Jun 30 18:28:47.402081 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-9cbae1e1-47f1-4a55-babb-b73c1d30a597 req-88313ce6-d8e5-40ec-91d7-72f59f981282 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117940) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 30 18:28:47.406817 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-e8508bdb-feb2-4f6e-ad57-6cb350949357 tempest-VolumesTestJSON-42413476 tempest-VolumesTestJSON-42413476-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.198792 Jun 30 18:28:47.407424 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 32/67] 10.222.0.33 () {58 vars in 1169 bytes} [Thu Jun 30 18:28:47 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:28:47.408255 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b6b476bd-41e5-450e-9a2c-9e258d6a9953 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:47.408894 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b6b476bd-41e5-450e-9a2c-9e258d6a9953 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:47.409928 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b6b476bd-41e5-450e-9a2c-9e258d6a9953 None None] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:47.410510 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b6b476bd-41e5-450e-9a2c-9e258d6a9953 None None] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:47.422072 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-adb3ba46-2221-43a5-9d70-b4ec3423c2af tempest-VolumesTestJSON-42413476 tempest-VolumesTestJSON-42413476-project] Calling method '.version_select at 0x7f18050c8af0>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:47.454622 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.compute.rpcapi [None req-b6b476bd-41e5-450e-9a2c-9e258d6a9953 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 30 18:28:47.458294 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b6b476bd-41e5-450e-9a2c-9e258d6a9953 None None] Releasing lock "compute-rpcapi-router" {{(pid=117940) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 30 18:28:47.499363 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-b6b476bd-41e5-450e-9a2c-9e258d6a9953 None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.235339 Jun 30 18:28:47.500147 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 36/68] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:28:47.516487 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-c2eaffd1-5b7b-4897-a6be-677dc5c0f03f tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] Calling method '.version_select at 0x7f18074f8700>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:47.588567 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-c2eaffd1-5b7b-4897-a6be-677dc5c0f03f tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/99280eab-183e-451a-87de-45e913e4143a" status: 200 len: 345 microversion: 2.1 time: 0.086266 Jun 30 18:28:47.590648 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-adb3ba46-2221-43a5-9d70-b4ec3423c2af tempest-VolumesTestJSON-42413476 tempest-VolumesTestJSON-42413476-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.173463 Jun 30 18:28:47.591687 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 37/69] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 30 18:28:47 2022] GET /compute/v2.1/os-volumes/99280eab-183e-451a-87de-45e913e4143a => generated 345 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:28:47.592057 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 33/70] 10.222.0.33 () {58 vars in 1154 bytes} [Thu Jun 30 18:28:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:28:47.603105 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-21249b2f-6454-4604-a504-419f7b5fbc77 tempest-VolumesTestJSON-42413476 tempest-VolumesTestJSON-42413476-project] Calling method '.version_select at 0x7f1805962700>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:47.755938 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-21249b2f-6454-4604-a504-419f7b5fbc77 tempest-VolumesTestJSON-42413476 tempest-VolumesTestJSON-42413476-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.156848 Jun 30 18:28:47.756930 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 38/71] 10.222.0.33 () {58 vars in 1187 bytes} [Thu Jun 30 18:28:47 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:28:47.770549 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-0afdf214-8a00-49ae-8cc0-62654ebd8bea tempest-VolumesTestJSON-42413476 tempest-VolumesTestJSON-42413476-project] Calling method '.version_select at 0x7f1805879a60>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:47.801968 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-e33122eb-9020-4edf-9f25-020cd9056016 req-38befe1e-476f-4bcb-b164-f3cfdca219f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "799aa3ef-4fdf-40c0-b76b-52ce98a386e8", "tag": "4db9cacb-c564-4286-bb44-3f838bceba71"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:28:47.815239 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-e33122eb-9020-4edf-9f25-020cd9056016 req-38befe1e-476f-4bcb-b164-f3cfdca219f6 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:47.815737 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-e33122eb-9020-4edf-9f25-020cd9056016 req-38befe1e-476f-4bcb-b164-f3cfdca219f6 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:47.836495 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.compute.server_external_events [req-e33122eb-9020-4edf-9f25-020cd9056016 req-38befe1e-476f-4bcb-b164-f3cfdca219f6 service nova] Creating event network-changed:4db9cacb-c564-4286-bb44-3f838bceba71 for instance 799aa3ef-4fdf-40c0-b76b-52ce98a386e8 on hv-cinder-80378 Jun 30 18:28:47.837376 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-e33122eb-9020-4edf-9f25-020cd9056016 req-38befe1e-476f-4bcb-b164-f3cfdca219f6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117941) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 30 18:28:47.838711 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ec0097f8-dbf9-4cdb-a28d-967e74f983b8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:47.839739 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ec0097f8-dbf9-4cdb-a28d-967e74f983b8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:47.840783 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ec0097f8-dbf9-4cdb-a28d-967e74f983b8 None None] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:47.841494 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ec0097f8-dbf9-4cdb-a28d-967e74f983b8 None None] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:47.852480 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.compute.rpcapi [None req-ec0097f8-dbf9-4cdb-a28d-967e74f983b8 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 30 18:28:47.853346 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ec0097f8-dbf9-4cdb-a28d-967e74f983b8 None None] Releasing lock "compute-rpcapi-router" {{(pid=117941) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 30 18:28:47.863480 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-0afdf214-8a00-49ae-8cc0-62654ebd8bea tempest-VolumesTestJSON-42413476 tempest-VolumesTestJSON-42413476-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.097910 Jun 30 18:28:47.864467 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 39/72] 10.222.0.33 () {58 vars in 1154 bytes} [Thu Jun 30 18:28:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:28:47.871166 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-ec0097f8-dbf9-4cdb-a28d-967e74f983b8 None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137519 Jun 30 18:28:47.871896 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 34/73] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:28:47.975706 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-d316ddc5-d6e9-4f58-94a8-edd6bd689f6b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:47.976461 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-d316ddc5-d6e9-4f58-94a8-edd6bd689f6b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:47.983261 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d316ddc5-d6e9-4f58-94a8-edd6bd689f6b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:47.983703 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d316ddc5-d6e9-4f58-94a8-edd6bd689f6b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:47.984456 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d316ddc5-d6e9-4f58-94a8-edd6bd689f6b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:47.984891 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d316ddc5-d6e9-4f58-94a8-edd6bd689f6b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:48.050842 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-d316ddc5-d6e9-4f58-94a8-edd6bd689f6b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:48.058984 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-d316ddc5-d6e9-4f58-94a8-edd6bd689f6b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:48.061356 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-d316ddc5-d6e9-4f58-94a8-edd6bd689f6b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:48.062483 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-d316ddc5-d6e9-4f58-94a8-edd6bd689f6b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1340 microversion: 2.20 time: 0.090596 Jun 30 18:28:48.063041 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 40/74] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:28:47 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1340 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:28:48.223778 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-f0dabb8e-b7fc-4155-9683-5b8135556608 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:48.224463 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-f0dabb8e-b7fc-4155-9683-5b8135556608 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:48.232125 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f0dabb8e-b7fc-4155-9683-5b8135556608 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:48.232560 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f0dabb8e-b7fc-4155-9683-5b8135556608 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:48.233301 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f0dabb8e-b7fc-4155-9683-5b8135556608 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:48.233752 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f0dabb8e-b7fc-4155-9683-5b8135556608 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:48.274084 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-f0dd7965-2c45-4ddc-9389-1e1be6503e4d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:48.274684 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-f0dd7965-2c45-4ddc-9389-1e1be6503e4d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:48.281656 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f0dd7965-2c45-4ddc-9389-1e1be6503e4d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:48.282027 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f0dd7965-2c45-4ddc-9389-1e1be6503e4d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:48.282787 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f0dd7965-2c45-4ddc-9389-1e1be6503e4d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:48.283212 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f0dd7965-2c45-4ddc-9389-1e1be6503e4d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:48.416862 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-f0dabb8e-b7fc-4155-9683-5b8135556608 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9762ad11e24246aefe2905eafe83f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96b506102ab4528956023c5e0f3dbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:48.424540 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-f0dabb8e-b7fc-4155-9683-5b8135556608 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 200 len: 1314 microversion: 2.1 time: 0.204913 Jun 30 18:28:48.425197 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 35/75] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:28:48 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:28:48.445514 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-f0dd7965-2c45-4ddc-9389-1e1be6503e4d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:48.453296 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-f0dd7965-2c45-4ddc-9389-1e1be6503e4d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1321 microversion: 2.1 time: 0.183307 Jun 30 18:28:48.453896 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 41/76] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:28:48 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:28:48.602875 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-73311e96-619a-40bf-aab2-c99e07b33671 tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] Calling method '.version_select at 0x7f18050bfc10>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:48.649939 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-73311e96-619a-40bf-aab2-c99e07b33671 tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/99280eab-183e-451a-87de-45e913e4143a" status: 200 len: 345 microversion: 2.1 time: 0.050762 Jun 30 18:28:48.650507 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 36/77] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 30 18:28:48 2022] GET /compute/v2.1/os-volumes/99280eab-183e-451a-87de-45e913e4143a => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:28:49.080617 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-8af9ffdb-8e37-4ac2-9432-7cfca1ea1ea0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:49.081223 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-8af9ffdb-8e37-4ac2-9432-7cfca1ea1ea0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:49.087328 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8af9ffdb-8e37-4ac2-9432-7cfca1ea1ea0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:49.087778 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8af9ffdb-8e37-4ac2-9432-7cfca1ea1ea0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:49.088549 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8af9ffdb-8e37-4ac2-9432-7cfca1ea1ea0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:49.089004 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8af9ffdb-8e37-4ac2-9432-7cfca1ea1ea0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:49.154062 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-8af9ffdb-8e37-4ac2-9432-7cfca1ea1ea0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:49.161888 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-8af9ffdb-8e37-4ac2-9432-7cfca1ea1ea0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:49.163396 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-8af9ffdb-8e37-4ac2-9432-7cfca1ea1ea0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:49.164478 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-8af9ffdb-8e37-4ac2-9432-7cfca1ea1ea0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1340 microversion: 2.20 time: 0.087856 Jun 30 18:28:49.165037 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 42/78] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:28:49 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1340 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 18:28:49.441078 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-d672dd3e-44d5-48b7-a165-2585dbf3c490 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:49.441703 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-d672dd3e-44d5-48b7-a165-2585dbf3c490 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:49.447669 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d672dd3e-44d5-48b7-a165-2585dbf3c490 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:49.448108 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d672dd3e-44d5-48b7-a165-2585dbf3c490 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:49.448846 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d672dd3e-44d5-48b7-a165-2585dbf3c490 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:49.449271 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d672dd3e-44d5-48b7-a165-2585dbf3c490 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:49.471806 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-c4889812-629e-4270-b8d6-c3569d67cb95 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:49.472414 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-c4889812-629e-4270-b8d6-c3569d67cb95 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:49.478435 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c4889812-629e-4270-b8d6-c3569d67cb95 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:49.478882 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c4889812-629e-4270-b8d6-c3569d67cb95 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:49.479636 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c4889812-629e-4270-b8d6-c3569d67cb95 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:49.480074 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c4889812-629e-4270-b8d6-c3569d67cb95 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:49.791976 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-d672dd3e-44d5-48b7-a165-2585dbf3c490 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9762ad11e24246aefe2905eafe83f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96b506102ab4528956023c5e0f3dbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:49.799189 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-c4889812-629e-4270-b8d6-c3569d67cb95 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:49.800357 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-d672dd3e-44d5-48b7-a165-2585dbf3c490 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 200 len: 1314 microversion: 2.1 time: 0.363075 Jun 30 18:28:49.800928 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 37/79] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:28:49 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:28:49.805477 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-363d8afc-1740-481f-a809-74866ce5f431 tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] Calling method '.version_select at 0x7f1805041670>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:49.806623 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-c4889812-629e-4270-b8d6-c3569d67cb95 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1321 microversion: 2.1 time: 0.338675 Jun 30 18:28:49.807186 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 43/80] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:28:49 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1321 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:28:49.853893 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-363d8afc-1740-481f-a809-74866ce5f431 tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/99280eab-183e-451a-87de-45e913e4143a" status: 200 len: 345 microversion: 2.1 time: 0.051683 Jun 30 18:28:49.854533 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 38/81] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 30 18:28:49 2022] GET /compute/v2.1/os-volumes/99280eab-183e-451a-87de-45e913e4143a => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:28:50.183158 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-481d39b6-a214-4723-9b8c-627705e05040 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:50.183769 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-481d39b6-a214-4723-9b8c-627705e05040 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:50.190545 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-481d39b6-a214-4723-9b8c-627705e05040 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:50.190991 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-481d39b6-a214-4723-9b8c-627705e05040 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:50.191742 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-481d39b6-a214-4723-9b8c-627705e05040 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:50.192178 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-481d39b6-a214-4723-9b8c-627705e05040 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:50.254982 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-481d39b6-a214-4723-9b8c-627705e05040 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:50.264179 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-481d39b6-a214-4723-9b8c-627705e05040 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:50.265774 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-481d39b6-a214-4723-9b8c-627705e05040 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:50.266891 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-481d39b6-a214-4723-9b8c-627705e05040 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1340 microversion: 2.20 time: 0.087590 Jun 30 18:28:50.267444 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 44/82] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:28:50 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1340 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:28:50.813908 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell0:SELECT=30 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:28:50.818274 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-ed35213a-9ee8-4e0b-af1b-9e0a66083a3b tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:50.818669 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-ed35213a-9ee8-4e0b-af1b-9e0a66083a3b tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:50.822119 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:28:50.823668 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-c8565b1b-300a-4177-9211-3d1fd06a050f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:50.824515 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-c8565b1b-300a-4177-9211-3d1fd06a050f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:50.827018 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ed35213a-9ee8-4e0b-af1b-9e0a66083a3b tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:50.827461 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ed35213a-9ee8-4e0b-af1b-9e0a66083a3b tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:50.828446 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ed35213a-9ee8-4e0b-af1b-9e0a66083a3b tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:50.828910 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ed35213a-9ee8-4e0b-af1b-9e0a66083a3b tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:50.831172 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c8565b1b-300a-4177-9211-3d1fd06a050f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:50.831693 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c8565b1b-300a-4177-9211-3d1fd06a050f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:50.832523 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c8565b1b-300a-4177-9211-3d1fd06a050f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:50.833266 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c8565b1b-300a-4177-9211-3d1fd06a050f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:51.025699 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-ed35213a-9ee8-4e0b-af1b-9e0a66083a3b tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9762ad11e24246aefe2905eafe83f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96b506102ab4528956023c5e0f3dbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:51.033418 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-c8565b1b-300a-4177-9211-3d1fd06a050f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:51.034396 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-ed35213a-9ee8-4e0b-af1b-9e0a66083a3b tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 200 len: 1314 microversion: 2.1 time: 0.221237 Jun 30 18:28:51.035324 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 39/83] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:28:50 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:28:51.041350 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-c8565b1b-300a-4177-9211-3d1fd06a050f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1321 microversion: 2.1 time: 0.221862 Jun 30 18:28:51.046694 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 45/84] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:28:50 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1321 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:28:51.050526 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-91ff90fe-6255-4eb9-b43b-6ccd04fecb82 tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] Calling method '.version_select at 0x7f18059d3670>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:51.097525 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-91ff90fe-6255-4eb9-b43b-6ccd04fecb82 tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/99280eab-183e-451a-87de-45e913e4143a" status: 200 len: 345 microversion: 2.1 time: 0.050870 Jun 30 18:28:51.098127 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 40/85] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 30 18:28:51 2022] GET /compute/v2.1/os-volumes/99280eab-183e-451a-87de-45e913e4143a => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:28:51.285959 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-6e081ba0-f07d-4d96-9ba3-f6d8f2d588bf tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:51.286597 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-6e081ba0-f07d-4d96-9ba3-f6d8f2d588bf tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:51.292734 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6e081ba0-f07d-4d96-9ba3-f6d8f2d588bf tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:51.293281 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6e081ba0-f07d-4d96-9ba3-f6d8f2d588bf tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:51.294077 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6e081ba0-f07d-4d96-9ba3-f6d8f2d588bf tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:51.295464 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6e081ba0-f07d-4d96-9ba3-f6d8f2d588bf tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:51.367530 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-6e081ba0-f07d-4d96-9ba3-f6d8f2d588bf tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:51.377313 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-6e081ba0-f07d-4d96-9ba3-f6d8f2d588bf tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:51.378850 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-6e081ba0-f07d-4d96-9ba3-f6d8f2d588bf tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:51.379963 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-6e081ba0-f07d-4d96-9ba3-f6d8f2d588bf tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1340 microversion: 2.20 time: 0.098722 Jun 30 18:28:51.380708 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 46/86] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:28:51 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1340 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:28:52.052213 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-bbaeb87f-f4d7-4406-8005-1e0b179b0e85 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:52.053049 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-bbaeb87f-f4d7-4406-8005-1e0b179b0e85 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:52.059058 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-6c37784c-6b1c-4bff-8680-204076f65a18 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:52.059597 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-bbaeb87f-f4d7-4406-8005-1e0b179b0e85 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:52.059706 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-bbaeb87f-f4d7-4406-8005-1e0b179b0e85 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:52.059804 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-6c37784c-6b1c-4bff-8680-204076f65a18 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:52.062215 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-bbaeb87f-f4d7-4406-8005-1e0b179b0e85 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:52.062334 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-bbaeb87f-f4d7-4406-8005-1e0b179b0e85 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:52.068861 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6c37784c-6b1c-4bff-8680-204076f65a18 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:52.069140 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6c37784c-6b1c-4bff-8680-204076f65a18 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:52.071157 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6c37784c-6b1c-4bff-8680-204076f65a18 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:52.071813 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6c37784c-6b1c-4bff-8680-204076f65a18 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:52.329972 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-6c37784c-6b1c-4bff-8680-204076f65a18 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:52.342074 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-6c37784c-6b1c-4bff-8680-204076f65a18 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1321 microversion: 2.1 time: 0.287175 Jun 30 18:28:52.342755 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 47/87] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:28:52 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1321 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:28:52.354051 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-606aeccb-5baa-4a36-9947-e99e1d0343af tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] Calling method '.version_select at 0x7f180592f3a0>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:52.357951 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-bbaeb87f-f4d7-4406-8005-1e0b179b0e85 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9762ad11e24246aefe2905eafe83f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96b506102ab4528956023c5e0f3dbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:52.366616 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-bbaeb87f-f4d7-4406-8005-1e0b179b0e85 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 200 len: 1314 microversion: 2.1 time: 0.318200 Jun 30 18:28:52.367607 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 41/88] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:28:52 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:28:52.400291 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-85431a89-b253-4569-a99d-afb42b2cbd06 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:52.401123 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-85431a89-b253-4569-a99d-afb42b2cbd06 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:52.411333 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-85431a89-b253-4569-a99d-afb42b2cbd06 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:52.414764 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-85431a89-b253-4569-a99d-afb42b2cbd06 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:52.415591 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-85431a89-b253-4569-a99d-afb42b2cbd06 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:52.416029 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-85431a89-b253-4569-a99d-afb42b2cbd06 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:52.430538 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.wsgi [None req-606aeccb-5baa-4a36-9947-e99e1d0343af tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] HTTP exception thrown: Volume 99280eab-183e-451a-87de-45e913e4143a could not be found. Jun 30 18:28:52.436849 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-606aeccb-5baa-4a36-9947-e99e1d0343af tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] Request method failure captured: Jun 30 18:28:52.436849 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: request: GET /compute/v2.1/os-volumes/99280eab-183e-451a-87de-45e913e4143a HTTP/1.1 Jun 30 18:28:52.436849 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept: application/json Jun 30 18:28:52.436849 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept-Encoding: identity Jun 30 18:28:52.436849 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Connection: close Jun 30 18:28:52.436849 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Length: 0 Jun 30 18:28:52.436849 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Type: application/json Jun 30 18:28:52.436849 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Host: 10.222.0.33 Jun 30 18:28:52.436849 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Openstack-System-Scope: None Jun 30 18:28:52.436849 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: User-Agent: python-urllib3/1.26.9 Jun 30 18:28:52.436849 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Auth-Token: gAAAAABivetFzjb3hR91tw7JUbhE2Pd-QGuGQicP2GrG013om7v98Kax326RfwZUMks8S6iER_3P59H8wzfUrFMmBBzPHz-luh9cgcidJ-MuOaqGTCiPg74TeRGpDUrmwgUFiVpDZIghkrEnLGFphMTJ7iKis4ORqmsW8xD5Ph7ZrwVpFy2o9xg Jun 30 18:28:52.436849 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Id: None Jun 30 18:28:52.436849 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Name: None Jun 30 18:28:52.436849 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Identity-Status: Confirmed Jun 30 18:28:52.436849 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Is-Admin-Project: True Jun 30 18:28:52.436849 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Id: default Jun 30 18:28:52.436849 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Name: Default Jun 30 18:28:52.436849 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Id: 6a127ed10b0a465aa487242a344defa0 Jun 30 18:28:52.436849 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1262642487 Jun 30 18:28:52.436849 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Role: reader,member Jun 30 18:28:52.436849 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Roles: reader,member Jun 30 18:28:52.438277 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6a127ed10b0a465aa487242a344defa0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6a127ed10b0a465aa487242a344defa0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6a127ed10b0a465aa487242a344defa0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6a127ed10b0a465aa487242a344defa0"}]}] Jun 30 18:28:52.438277 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1262642487 Jun 30 18:28:52.438277 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Id: 6a127ed10b0a465aa487242a344defa0 Jun 30 18:28:52.438277 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1262642487 Jun 30 18:28:52.438277 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User: tempest-VolumesSnapshotsTestJSON-1262642487-project Jun 30 18:28:52.438277 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Id: default Jun 30 18:28:52.438277 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Name: Default Jun 30 18:28:52.438277 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Id: 4f262bfdf0d54e76a77e8ce8cda137dc Jun 30 18:28:52.438277 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1262642487-project Jun 30 18:28:52.438277 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: method: Jun 30 18:28:52.438277 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: exception: Volume 99280eab-183e-451a-87de-45e913e4143a could not be found. Jun 30 18:28:52.438277 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: action_args: {'id': '99280eab-183e-451a-87de-45e913e4143a'} Jun 30 18:28:52.438277 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:28:52.439111 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:28:52.439111 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 18:28:52.439111 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 18:28:52.439111 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 18:28:52.439111 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 18:28:52.439111 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 18:28:52.439111 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 18:28:52.439111 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 18:28:52.439111 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 18:28:52.439111 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 18:28:52.439111 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 18:28:52.439111 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 18:28:52.439111 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 18:28:52.439111 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 18:28:52.439111 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 18:28:52.439111 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 99280eab-183e-451a-87de-45e913e4143a could not be found. (HTTP 404) (Request-ID: req-8cb3f0eb-065f-4230-8a48-56453d348190) Jun 30 18:28:52.439111 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:28:52.439111 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:28:52.439111 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:28:52.440295 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:28:52.440295 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 30 18:28:52.440295 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 30 18:28:52.440295 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 18:28:52.440295 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 18:28:52.440295 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 18:28:52.440295 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 18:28:52.440295 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 18:28:52.440295 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 18:28:52.440295 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 18:28:52.440295 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 18:28:52.440295 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 18:28:52.440295 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 18:28:52.440295 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 18:28:52.440295 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 18:28:52.440295 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 18:28:52.440295 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 18:28:52.440295 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 18:28:52.440295 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 18:28:52.441445 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 18:28:52.441445 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 18:28:52.441445 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 18:28:52.441445 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 18:28:52.441445 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 99280eab-183e-451a-87de-45e913e4143a could not be found. Jun 30 18:28:52.441445 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:28:52.441445 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:28:52.441445 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:28:52.441445 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:28:52.441445 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:28:52.441445 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:28:52.441445 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:28:52.441445 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:28:52.441445 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 18:28:52.441445 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 18:28:52.441445 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:28:52.441445 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:28:52.441445 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 30 18:28:52.441445 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:28:52.442876 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 99280eab-183e-451a-87de-45e913e4143a could not be found. Jun 30 18:28:52.442876 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:28:52.442876 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:28:52.442876 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:28:52.442876 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:28:52.442876 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:28:52.442876 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:28:52.442876 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:28:52.442876 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:28:52.442876 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 99280eab-183e-451a-87de-45e913e4143a could not be found. Jun 30 18:28:52.442876 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:28:52.444329 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-606aeccb-5baa-4a36-9947-e99e1d0343af tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] Returning 404 to user: Volume 99280eab-183e-451a-87de-45e913e4143a could not be found. {{(pid=117940) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:28:52.445278 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-606aeccb-5baa-4a36-9947-e99e1d0343af tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/99280eab-183e-451a-87de-45e913e4143a" status: 404 len: 109 microversion: 2.1 time: 0.101610 Jun 30 18:28:52.445970 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 48/89] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 30 18:28:52 2022] GET /compute/v2.1/os-volumes/99280eab-183e-451a-87de-45e913e4143a => generated 109 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:28:52.466772 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-a269d216-be5a-44cd-94f9-09fd6f4726f7 tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] Calling method '.version_select at 0x7f18058790d0>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:52.514440 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-85431a89-b253-4569-a99d-afb42b2cbd06 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:52.525261 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-85431a89-b253-4569-a99d-afb42b2cbd06 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:52.527131 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-85431a89-b253-4569-a99d-afb42b2cbd06 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:52.528427 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-85431a89-b253-4569-a99d-afb42b2cbd06 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1340 microversion: 2.20 time: 0.132689 Jun 30 18:28:52.529622 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 42/90] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:28:52 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1340 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:28:52.542961 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.wsgi [None req-a269d216-be5a-44cd-94f9-09fd6f4726f7 tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] HTTP exception thrown: Volume 99280eab-183e-451a-87de-45e913e4143a could not be found. Jun 30 18:28:52.546625 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-a269d216-be5a-44cd-94f9-09fd6f4726f7 tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] Request method failure captured: Jun 30 18:28:52.546625 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: request: DELETE /compute/v2.1/os-volumes/99280eab-183e-451a-87de-45e913e4143a HTTP/1.1 Jun 30 18:28:52.546625 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept: application/json Jun 30 18:28:52.546625 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept-Encoding: identity Jun 30 18:28:52.546625 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Connection: close Jun 30 18:28:52.546625 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Length: 0 Jun 30 18:28:52.546625 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Type: application/json Jun 30 18:28:52.546625 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Host: 10.222.0.33 Jun 30 18:28:52.546625 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Openstack-System-Scope: None Jun 30 18:28:52.546625 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: User-Agent: python-urllib3/1.26.9 Jun 30 18:28:52.546625 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Auth-Token: gAAAAABivetFzjb3hR91tw7JUbhE2Pd-QGuGQicP2GrG013om7v98Kax326RfwZUMks8S6iER_3P59H8wzfUrFMmBBzPHz-luh9cgcidJ-MuOaqGTCiPg74TeRGpDUrmwgUFiVpDZIghkrEnLGFphMTJ7iKis4ORqmsW8xD5Ph7ZrwVpFy2o9xg Jun 30 18:28:52.546625 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Id: None Jun 30 18:28:52.546625 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Name: None Jun 30 18:28:52.546625 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Identity-Status: Confirmed Jun 30 18:28:52.546625 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Is-Admin-Project: True Jun 30 18:28:52.546625 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Id: default Jun 30 18:28:52.546625 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Name: Default Jun 30 18:28:52.546625 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Id: 6a127ed10b0a465aa487242a344defa0 Jun 30 18:28:52.546625 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1262642487 Jun 30 18:28:52.546625 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Role: reader,member Jun 30 18:28:52.546625 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Roles: reader,member Jun 30 18:28:52.548354 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6a127ed10b0a465aa487242a344defa0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6a127ed10b0a465aa487242a344defa0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6a127ed10b0a465aa487242a344defa0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6a127ed10b0a465aa487242a344defa0"}]}] Jun 30 18:28:52.548354 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1262642487 Jun 30 18:28:52.548354 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Id: 6a127ed10b0a465aa487242a344defa0 Jun 30 18:28:52.548354 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1262642487 Jun 30 18:28:52.548354 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User: tempest-VolumesSnapshotsTestJSON-1262642487-project Jun 30 18:28:52.548354 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Id: default Jun 30 18:28:52.548354 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Name: Default Jun 30 18:28:52.548354 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Id: 4f262bfdf0d54e76a77e8ce8cda137dc Jun 30 18:28:52.548354 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1262642487-project Jun 30 18:28:52.548354 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: method: Jun 30 18:28:52.548354 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: exception: Volume 99280eab-183e-451a-87de-45e913e4143a could not be found. Jun 30 18:28:52.548354 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: action_args: {'id': '99280eab-183e-451a-87de-45e913e4143a'} Jun 30 18:28:52.548354 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:28:52.549440 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:28:52.549440 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 18:28:52.549440 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 18:28:52.549440 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 18:28:52.549440 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 18:28:52.549440 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 18:28:52.549440 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 18:28:52.549440 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 18:28:52.549440 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 18:28:52.549440 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 18:28:52.549440 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 18:28:52.549440 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 18:28:52.549440 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 18:28:52.549440 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 18:28:52.549440 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 18:28:52.549440 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 99280eab-183e-451a-87de-45e913e4143a could not be found. (HTTP 404) (Request-ID: req-6cafb800-81cc-453e-a31c-960c63574859) Jun 30 18:28:52.549440 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:28:52.549440 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:28:52.549440 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:28:52.551190 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:28:52.551190 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 30 18:28:52.551190 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 30 18:28:52.551190 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 18:28:52.551190 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 18:28:52.551190 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 18:28:52.551190 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 18:28:52.551190 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 18:28:52.551190 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 18:28:52.551190 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 18:28:52.551190 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 18:28:52.551190 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 18:28:52.551190 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 18:28:52.551190 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 18:28:52.551190 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 18:28:52.551190 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 18:28:52.551190 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 18:28:52.551190 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 18:28:52.551190 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 18:28:52.553442 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 18:28:52.553442 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 18:28:52.553442 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 18:28:52.553442 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 18:28:52.553442 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 99280eab-183e-451a-87de-45e913e4143a could not be found. Jun 30 18:28:52.553442 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:28:52.553442 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:28:52.553442 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:28:52.553442 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:28:52.553442 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:28:52.553442 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:28:52.553442 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:28:52.553442 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:28:52.553442 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 18:28:52.553442 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 18:28:52.553442 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:28:52.553442 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:28:52.553442 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 30 18:28:52.553442 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:28:52.555577 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 99280eab-183e-451a-87de-45e913e4143a could not be found. Jun 30 18:28:52.555577 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:28:52.555577 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:28:52.555577 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:28:52.555577 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:28:52.555577 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:28:52.555577 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:28:52.555577 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:28:52.555577 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:28:52.555577 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 99280eab-183e-451a-87de-45e913e4143a could not be found. Jun 30 18:28:52.555577 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:28:52.555577 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-a269d216-be5a-44cd-94f9-09fd6f4726f7 tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] Returning 404 to user: Volume 99280eab-183e-451a-87de-45e913e4143a could not be found. {{(pid=117940) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:28:52.555577 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-a269d216-be5a-44cd-94f9-09fd6f4726f7 tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/99280eab-183e-451a-87de-45e913e4143a" status: 404 len: 109 microversion: 2.1 time: 0.098418 Jun 30 18:28:52.555577 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 49/91] 10.222.0.33 () {58 vars in 1247 bytes} [Thu Jun 30 18:28:52 2022] DELETE /compute/v2.1/os-volumes/99280eab-183e-451a-87de-45e913e4143a => generated 109 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:28:52.564733 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-89635f6e-94e9-4940-b99b-38d1e94228b6 tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] Calling method '.version_select at 0x7f1805093040>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:52.602503 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.wsgi [None req-89635f6e-94e9-4940-b99b-38d1e94228b6 tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] HTTP exception thrown: Volume 99280eab-183e-451a-87de-45e913e4143a could not be found. Jun 30 18:28:52.607485 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-89635f6e-94e9-4940-b99b-38d1e94228b6 tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] Request method failure captured: Jun 30 18:28:52.607485 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: request: GET /compute/v2.1/os-volumes/99280eab-183e-451a-87de-45e913e4143a HTTP/1.1 Jun 30 18:28:52.607485 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept: application/json Jun 30 18:28:52.607485 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept-Encoding: identity Jun 30 18:28:52.607485 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Connection: close Jun 30 18:28:52.607485 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Length: 0 Jun 30 18:28:52.607485 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Type: application/json Jun 30 18:28:52.607485 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Host: 10.222.0.33 Jun 30 18:28:52.607485 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Openstack-System-Scope: None Jun 30 18:28:52.607485 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: User-Agent: python-urllib3/1.26.9 Jun 30 18:28:52.607485 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Auth-Token: gAAAAABivetFzjb3hR91tw7JUbhE2Pd-QGuGQicP2GrG013om7v98Kax326RfwZUMks8S6iER_3P59H8wzfUrFMmBBzPHz-luh9cgcidJ-MuOaqGTCiPg74TeRGpDUrmwgUFiVpDZIghkrEnLGFphMTJ7iKis4ORqmsW8xD5Ph7ZrwVpFy2o9xg Jun 30 18:28:52.607485 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Id: None Jun 30 18:28:52.607485 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Name: None Jun 30 18:28:52.607485 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Identity-Status: Confirmed Jun 30 18:28:52.607485 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Is-Admin-Project: True Jun 30 18:28:52.607485 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Id: default Jun 30 18:28:52.607485 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Name: Default Jun 30 18:28:52.607485 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Id: 6a127ed10b0a465aa487242a344defa0 Jun 30 18:28:52.607485 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1262642487 Jun 30 18:28:52.607485 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Role: reader,member Jun 30 18:28:52.607485 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Roles: reader,member Jun 30 18:28:52.608647 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6a127ed10b0a465aa487242a344defa0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6a127ed10b0a465aa487242a344defa0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6a127ed10b0a465aa487242a344defa0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6a127ed10b0a465aa487242a344defa0"}]}] Jun 30 18:28:52.608647 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1262642487 Jun 30 18:28:52.608647 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Id: 6a127ed10b0a465aa487242a344defa0 Jun 30 18:28:52.608647 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1262642487 Jun 30 18:28:52.608647 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User: tempest-VolumesSnapshotsTestJSON-1262642487-project Jun 30 18:28:52.608647 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Id: default Jun 30 18:28:52.608647 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Name: Default Jun 30 18:28:52.608647 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Id: 4f262bfdf0d54e76a77e8ce8cda137dc Jun 30 18:28:52.608647 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1262642487-project Jun 30 18:28:52.608647 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: method: Jun 30 18:28:52.608647 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: exception: Volume 99280eab-183e-451a-87de-45e913e4143a could not be found. Jun 30 18:28:52.608647 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: action_args: {'id': '99280eab-183e-451a-87de-45e913e4143a'} Jun 30 18:28:52.608647 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:28:52.609384 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:28:52.609384 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 18:28:52.609384 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 18:28:52.609384 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 18:28:52.609384 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 18:28:52.609384 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 18:28:52.609384 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 18:28:52.609384 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 18:28:52.609384 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 18:28:52.609384 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 18:28:52.609384 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 18:28:52.609384 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 18:28:52.609384 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 18:28:52.609384 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 18:28:52.609384 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 18:28:52.609384 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 99280eab-183e-451a-87de-45e913e4143a could not be found. (HTTP 404) (Request-ID: req-accf6109-ab86-4df4-8237-89485f3fd91b) Jun 30 18:28:52.609384 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:28:52.609384 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:28:52.609384 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:28:52.610423 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:28:52.610423 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 30 18:28:52.610423 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 30 18:28:52.610423 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 18:28:52.610423 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 18:28:52.610423 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 18:28:52.610423 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 18:28:52.610423 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 18:28:52.610423 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 18:28:52.610423 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 18:28:52.610423 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 18:28:52.610423 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 18:28:52.610423 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 18:28:52.610423 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 18:28:52.610423 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 18:28:52.610423 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 18:28:52.610423 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 18:28:52.610423 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 18:28:52.610423 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 18:28:52.611654 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 18:28:52.611654 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 18:28:52.611654 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 18:28:52.611654 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 18:28:52.611654 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 99280eab-183e-451a-87de-45e913e4143a could not be found. Jun 30 18:28:52.611654 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:28:52.611654 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:28:52.611654 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:28:52.611654 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:28:52.611654 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:28:52.611654 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:28:52.611654 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:28:52.611654 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:28:52.611654 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 18:28:52.611654 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 18:28:52.611654 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:28:52.611654 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:28:52.611654 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 30 18:28:52.611654 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:28:52.612640 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 99280eab-183e-451a-87de-45e913e4143a could not be found. Jun 30 18:28:52.612640 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:28:52.612640 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:28:52.612640 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:28:52.612640 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:28:52.612640 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:28:52.612640 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:28:52.612640 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:28:52.612640 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:28:52.612640 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 99280eab-183e-451a-87de-45e913e4143a could not be found. Jun 30 18:28:52.612640 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:28:52.616086 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-89635f6e-94e9-4940-b99b-38d1e94228b6 tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] Returning 404 to user: Volume 99280eab-183e-451a-87de-45e913e4143a could not be found. {{(pid=117941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:28:52.617659 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-89635f6e-94e9-4940-b99b-38d1e94228b6 tempest-VolumesSnapshotsTestJSON-1262642487 tempest-VolumesSnapshotsTestJSON-1262642487-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/99280eab-183e-451a-87de-45e913e4143a" status: 404 len: 109 microversion: 2.1 time: 0.058665 Jun 30 18:28:52.618847 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 43/92] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 30 18:28:52 2022] GET /compute/v2.1/os-volumes/99280eab-183e-451a-87de-45e913e4143a => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:28:53.359944 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-364624df-3ab5-448a-b16a-b5607642ace9 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:53.361415 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-364624df-3ab5-448a-b16a-b5607642ace9 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:53.380062 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-364624df-3ab5-448a-b16a-b5607642ace9 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:53.382078 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-364624df-3ab5-448a-b16a-b5607642ace9 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:53.385739 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-364624df-3ab5-448a-b16a-b5607642ace9 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:53.386548 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-6f4eadf0-1a68-4e60-87e0-f903b4045837 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:53.387193 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-6f4eadf0-1a68-4e60-87e0-f903b4045837 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:53.390101 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-364624df-3ab5-448a-b16a-b5607642ace9 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:53.401116 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6f4eadf0-1a68-4e60-87e0-f903b4045837 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:53.403086 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6f4eadf0-1a68-4e60-87e0-f903b4045837 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:53.406735 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6f4eadf0-1a68-4e60-87e0-f903b4045837 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:53.407428 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6f4eadf0-1a68-4e60-87e0-f903b4045837 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:53.815030 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-364624df-3ab5-448a-b16a-b5607642ace9 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:53.826871 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-364624df-3ab5-448a-b16a-b5607642ace9 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1321 microversion: 2.1 time: 0.468696 Jun 30 18:28:53.828871 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 50/93] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:28:53 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1321 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:28:53.834830 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-6f4eadf0-1a68-4e60-87e0-f903b4045837 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9762ad11e24246aefe2905eafe83f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96b506102ab4528956023c5e0f3dbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:53.840640 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-91ffe3c3-348c-4fbf-bbe6-20e7f0ef28d5 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:53.841930 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-91ffe3c3-348c-4fbf-bbe6-20e7f0ef28d5 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:53.844844 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-6f4eadf0-1a68-4e60-87e0-f903b4045837 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 200 len: 1314 microversion: 2.1 time: 0.463796 Jun 30 18:28:53.854964 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 44/94] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:28:53 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 1314 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:28:53.866503 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-91ffe3c3-348c-4fbf-bbe6-20e7f0ef28d5 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:53.867282 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-91ffe3c3-348c-4fbf-bbe6-20e7f0ef28d5 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:53.868306 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-91ffe3c3-348c-4fbf-bbe6-20e7f0ef28d5 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:53.871133 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-91ffe3c3-348c-4fbf-bbe6-20e7f0ef28d5 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:53.977715 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-91ffe3c3-348c-4fbf-bbe6-20e7f0ef28d5 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:53.987446 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-91ffe3c3-348c-4fbf-bbe6-20e7f0ef28d5 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:53.988942 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-91ffe3c3-348c-4fbf-bbe6-20e7f0ef28d5 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:53.994627 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-91ffe3c3-348c-4fbf-bbe6-20e7f0ef28d5 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1340 microversion: 2.20 time: 0.159897 Jun 30 18:28:53.995222 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 51/95] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:28:53 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1340 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:28:54.845912 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-c07bb199-f4d7-4123-8142-fae055c7105b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:54.846738 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-c07bb199-f4d7-4123-8142-fae055c7105b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:54.852840 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c07bb199-f4d7-4123-8142-fae055c7105b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:54.853689 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c07bb199-f4d7-4123-8142-fae055c7105b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:54.854629 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c07bb199-f4d7-4123-8142-fae055c7105b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:54.855303 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c07bb199-f4d7-4123-8142-fae055c7105b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:54.862170 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-f7671e5f-4774-49dc-8253-93ccf45870dc tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:54.863348 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-f7671e5f-4774-49dc-8253-93ccf45870dc tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:54.872881 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f7671e5f-4774-49dc-8253-93ccf45870dc tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:54.873693 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f7671e5f-4774-49dc-8253-93ccf45870dc tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:54.878636 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f7671e5f-4774-49dc-8253-93ccf45870dc tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:54.879080 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f7671e5f-4774-49dc-8253-93ccf45870dc tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:55.111472 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-c07bb199-f4d7-4123-8142-fae055c7105b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:55.122340 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-c07bb199-f4d7-4123-8142-fae055c7105b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1321 microversion: 2.1 time: 0.280614 Jun 30 18:28:55.123546 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 45/96] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:28:54 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1321 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:28:55.126781 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-f7671e5f-4774-49dc-8253-93ccf45870dc tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9762ad11e24246aefe2905eafe83f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96b506102ab4528956023c5e0f3dbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:55.129505 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-45d8cbc2-931b-4e46-9da5-3ed19c62ba1f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:55.130260 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-45d8cbc2-931b-4e46-9da5-3ed19c62ba1f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:55.136308 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-45d8cbc2-931b-4e46-9da5-3ed19c62ba1f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:55.136756 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-45d8cbc2-931b-4e46-9da5-3ed19c62ba1f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:55.137561 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-45d8cbc2-931b-4e46-9da5-3ed19c62ba1f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:55.138020 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-45d8cbc2-931b-4e46-9da5-3ed19c62ba1f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:55.141900 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-f7671e5f-4774-49dc-8253-93ccf45870dc tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 200 len: 1314 microversion: 2.1 time: 0.283553 Jun 30 18:28:55.142477 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 52/97] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:28:54 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:28:55.218413 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-45d8cbc2-931b-4e46-9da5-3ed19c62ba1f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:55.221912 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell1:SELECT=100 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:28:55.227217 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-45d8cbc2-931b-4e46-9da5-3ed19c62ba1f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:55.228718 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-45d8cbc2-931b-4e46-9da5-3ed19c62ba1f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:55.229972 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-45d8cbc2-931b-4e46-9da5-3ed19c62ba1f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1340 microversion: 2.20 time: 0.105425 Jun 30 18:28:55.230536 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 46/98] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:28:55 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1340 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:28:55.412129 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-9a20cc01-39dd-4375-adc6-8aad73240581 tempest-VolumesGetTestJSON-189318919 tempest-VolumesGetTestJSON-189318919-project] Action: 'create', calling method: .version_select at 0x7f1805879a60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-201421427", "metadata": {"Type": "work"}}} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:28:55.770565 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-9a20cc01-39dd-4375-adc6-8aad73240581 tempest-VolumesGetTestJSON-189318919 tempest-VolumesGetTestJSON-189318919-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.626825 Jun 30 18:28:55.771369 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 53/99] 10.222.0.33 () {60 vars in 1155 bytes} [Thu Jun 30 18:28:55 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 628 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 30 18:28:55.785067 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-180a3c4b-3b9b-4144-a5f2-301989117ed2 tempest-VolumesGetTestJSON-189318919 tempest-VolumesGetTestJSON-189318919-project] Calling method '.version_select at 0x7f18050bf4c0>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:55.837702 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-180a3c4b-3b9b-4144-a5f2-301989117ed2 tempest-VolumesGetTestJSON-189318919 tempest-VolumesGetTestJSON-189318919-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/91d7a266-bf00-43e2-bee6-12d3d04e86e3" status: 200 len: 352 microversion: 2.1 time: 0.058842 Jun 30 18:28:55.838339 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 47/100] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 30 18:28:55 2022] GET /compute/v2.1/os-volumes/91d7a266-bf00-43e2-bee6-12d3d04e86e3 => generated 352 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:28:56.142319 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-81a79824-3021-4153-baa0-77c288c4ed6a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:56.143963 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-81a79824-3021-4153-baa0-77c288c4ed6a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:56.159798 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-20186581-f9d1-48df-95d8-7cfd46bb8d39 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:56.160619 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-20186581-f9d1-48df-95d8-7cfd46bb8d39 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:56.177302 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-81a79824-3021-4153-baa0-77c288c4ed6a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:56.177878 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-81a79824-3021-4153-baa0-77c288c4ed6a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:56.178883 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-81a79824-3021-4153-baa0-77c288c4ed6a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:56.179455 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-81a79824-3021-4153-baa0-77c288c4ed6a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:56.179593 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-20186581-f9d1-48df-95d8-7cfd46bb8d39 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:56.180120 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-20186581-f9d1-48df-95d8-7cfd46bb8d39 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:56.181199 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-20186581-f9d1-48df-95d8-7cfd46bb8d39 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:56.181880 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-20186581-f9d1-48df-95d8-7cfd46bb8d39 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:56.412604 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-20186581-f9d1-48df-95d8-7cfd46bb8d39 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9762ad11e24246aefe2905eafe83f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96b506102ab4528956023c5e0f3dbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:56.420297 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-81a79824-3021-4153-baa0-77c288c4ed6a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:56.429492 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-20186581-f9d1-48df-95d8-7cfd46bb8d39 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 200 len: 1314 microversion: 2.1 time: 0.271528 Jun 30 18:28:56.429492 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 48/101] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:28:56 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:28:56.436079 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-508c0306-6138-46c9-90f8-45ae65e2d1b4 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:56.438873 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-81a79824-3021-4153-baa0-77c288c4ed6a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1321 microversion: 2.1 time: 0.302788 Jun 30 18:28:56.439669 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-508c0306-6138-46c9-90f8-45ae65e2d1b4 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:56.442023 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 54/102] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:28:56 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1321 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:28:56.447282 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-508c0306-6138-46c9-90f8-45ae65e2d1b4 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:56.447926 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-508c0306-6138-46c9-90f8-45ae65e2d1b4 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:56.448834 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-508c0306-6138-46c9-90f8-45ae65e2d1b4 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:56.449407 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-508c0306-6138-46c9-90f8-45ae65e2d1b4 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:56.525550 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-508c0306-6138-46c9-90f8-45ae65e2d1b4 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:56.535999 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-508c0306-6138-46c9-90f8-45ae65e2d1b4 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:56.538149 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-508c0306-6138-46c9-90f8-45ae65e2d1b4 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:56.539457 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-508c0306-6138-46c9-90f8-45ae65e2d1b4 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1340 microversion: 2.20 time: 0.110999 Jun 30 18:28:56.540097 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 49/103] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:28:56 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1340 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:28:56.850992 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-1e9acf9e-fa4e-432f-8dbb-79c394791913 tempest-VolumesGetTestJSON-189318919 tempest-VolumesGetTestJSON-189318919-project] Calling method '.version_select at 0x7f180592f1f0>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:56.901324 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-1e9acf9e-fa4e-432f-8dbb-79c394791913 tempest-VolumesGetTestJSON-189318919 tempest-VolumesGetTestJSON-189318919-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/91d7a266-bf00-43e2-bee6-12d3d04e86e3" status: 200 len: 352 microversion: 2.1 time: 0.054024 Jun 30 18:28:56.902212 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 55/104] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 30 18:28:56 2022] GET /compute/v2.1/os-volumes/91d7a266-bf00-43e2-bee6-12d3d04e86e3 => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:28:57.444995 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-91d28ad1-b9f2-4987-bc65-a2bb7d7d0fcd tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:57.445559 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-91d28ad1-b9f2-4987-bc65-a2bb7d7d0fcd tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:57.452063 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-91d28ad1-b9f2-4987-bc65-a2bb7d7d0fcd tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:57.452518 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-91d28ad1-b9f2-4987-bc65-a2bb7d7d0fcd tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:57.453346 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-91d28ad1-b9f2-4987-bc65-a2bb7d7d0fcd tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:57.453980 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-91d28ad1-b9f2-4987-bc65-a2bb7d7d0fcd tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:57.458759 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-d0464f82-62a4-403f-9654-a2792e6b6fdc tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:57.460061 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-d0464f82-62a4-403f-9654-a2792e6b6fdc tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:57.467537 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell0:SELECT=2 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:28:57.469910 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d0464f82-62a4-403f-9654-a2792e6b6fdc tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:57.470823 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d0464f82-62a4-403f-9654-a2792e6b6fdc tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:57.472318 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d0464f82-62a4-403f-9654-a2792e6b6fdc tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:57.473197 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d0464f82-62a4-403f-9654-a2792e6b6fdc tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:57.797888 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-d0464f82-62a4-403f-9654-a2792e6b6fdc tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:57.804116 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-91d28ad1-b9f2-4987-bc65-a2bb7d7d0fcd tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9762ad11e24246aefe2905eafe83f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96b506102ab4528956023c5e0f3dbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:57.805501 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-d0464f82-62a4-403f-9654-a2792e6b6fdc tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1321 microversion: 2.1 time: 0.351027 Jun 30 18:28:57.806103 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 56/105] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:28:57 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1321 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:28:57.811188 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-b6828886-a193-4e8d-9689-35b0440f51aa tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:57.812421 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-b6828886-a193-4e8d-9689-35b0440f51aa tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:57.812719 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-91d28ad1-b9f2-4987-bc65-a2bb7d7d0fcd tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 200 len: 1314 microversion: 2.1 time: 0.372111 Jun 30 18:28:57.813292 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 50/106] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:28:57 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 1314 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:28:57.818666 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b6828886-a193-4e8d-9689-35b0440f51aa tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:57.819109 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b6828886-a193-4e8d-9689-35b0440f51aa tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:57.819882 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b6828886-a193-4e8d-9689-35b0440f51aa tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:57.820312 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b6828886-a193-4e8d-9689-35b0440f51aa tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:57.889821 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-b6828886-a193-4e8d-9689-35b0440f51aa tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:57.898769 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-b6828886-a193-4e8d-9689-35b0440f51aa tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:57.900264 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-b6828886-a193-4e8d-9689-35b0440f51aa tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:57.901405 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-b6828886-a193-4e8d-9689-35b0440f51aa tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1340 microversion: 2.20 time: 0.094229 Jun 30 18:28:57.902042 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 57/107] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:28:57 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1340 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:28:57.913724 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-387c1d88-248c-4b7d-a4d9-b2c364683f38 tempest-VolumesGetTestJSON-189318919 tempest-VolumesGetTestJSON-189318919-project] Calling method '.version_select at 0x7f18050bf4c0>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:57.920141 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell0:SELECT=8 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:28:57.968668 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-387c1d88-248c-4b7d-a4d9-b2c364683f38 tempest-VolumesGetTestJSON-189318919 tempest-VolumesGetTestJSON-189318919-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/91d7a266-bf00-43e2-bee6-12d3d04e86e3" status: 200 len: 352 microversion: 2.1 time: 0.058799 Jun 30 18:28:57.969334 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 51/108] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 30 18:28:57 2022] GET /compute/v2.1/os-volumes/91d7a266-bf00-43e2-bee6-12d3d04e86e3 => generated 352 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:28:58.823221 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-51f814c2-b195-4b97-a3b0-88cc101b56b8 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:58.823829 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-51f814c2-b195-4b97-a3b0-88cc101b56b8 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:58.830422 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-e3279718-bde0-4621-927c-55b2d991b6f0 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:58.830959 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-51f814c2-b195-4b97-a3b0-88cc101b56b8 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:58.830959 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-51f814c2-b195-4b97-a3b0-88cc101b56b8 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:58.831272 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-e3279718-bde0-4621-927c-55b2d991b6f0 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:58.832371 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-51f814c2-b195-4b97-a3b0-88cc101b56b8 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:58.833328 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-51f814c2-b195-4b97-a3b0-88cc101b56b8 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:58.837129 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e3279718-bde0-4621-927c-55b2d991b6f0 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:58.837614 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e3279718-bde0-4621-927c-55b2d991b6f0 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:58.838679 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e3279718-bde0-4621-927c-55b2d991b6f0 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:58.839122 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e3279718-bde0-4621-927c-55b2d991b6f0 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:59.036420 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-51f814c2-b195-4b97-a3b0-88cc101b56b8 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:59.040531 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-e3279718-bde0-4621-927c-55b2d991b6f0 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9762ad11e24246aefe2905eafe83f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96b506102ab4528956023c5e0f3dbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:59.043801 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-51f814c2-b195-4b97-a3b0-88cc101b56b8 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1321 microversion: 2.1 time: 0.224694 Jun 30 18:28:59.044381 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 58/109] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:28:58 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:28:59.049901 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-e3279718-bde0-4621-927c-55b2d991b6f0 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 200 len: 1314 microversion: 2.1 time: 0.224448 Jun 30 18:28:59.050628 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-a439c93f-11e8-414e-b7d4-0050ebc8ffb6 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:59.050754 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 52/110] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:28:58 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:28:59.051287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-a439c93f-11e8-414e-b7d4-0050ebc8ffb6 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:59.057331 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a439c93f-11e8-414e-b7d4-0050ebc8ffb6 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:59.057813 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a439c93f-11e8-414e-b7d4-0050ebc8ffb6 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:59.058561 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a439c93f-11e8-414e-b7d4-0050ebc8ffb6 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:59.058985 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a439c93f-11e8-414e-b7d4-0050ebc8ffb6 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:59.064471 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-db4a8e7c-9fb1-4e86-96f9-ff864a8ccf6d tempest-VolumesGetTestJSON-189318919 tempest-VolumesGetTestJSON-189318919-project] Calling method '.version_select at 0x7f1805041dc0>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:59.121737 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-db4a8e7c-9fb1-4e86-96f9-ff864a8ccf6d tempest-VolumesGetTestJSON-189318919 tempest-VolumesGetTestJSON-189318919-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/91d7a266-bf00-43e2-bee6-12d3d04e86e3" status: 200 len: 352 microversion: 2.1 time: 0.061713 Jun 30 18:28:59.123385 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 53/111] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 30 18:28:59 2022] GET /compute/v2.1/os-volumes/91d7a266-bf00-43e2-bee6-12d3d04e86e3 => generated 352 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:28:59.130106 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-a439c93f-11e8-414e-b7d4-0050ebc8ffb6 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:59.139307 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-a439c93f-11e8-414e-b7d4-0050ebc8ffb6 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:59.140818 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-a439c93f-11e8-414e-b7d4-0050ebc8ffb6 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:59.141979 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-a439c93f-11e8-414e-b7d4-0050ebc8ffb6 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1340 microversion: 2.20 time: 0.096061 Jun 30 18:28:59.142542 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 59/112] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:28:59 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1340 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:29:00.061211 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-c01df2a9-6a04-49d8-bab9-1f8df5c7f56e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:00.062255 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-c01df2a9-6a04-49d8-bab9-1f8df5c7f56e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:00.067299 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-8679e906-d4d8-48f1-b29a-e69e048e64d2 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:00.067917 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-8679e906-d4d8-48f1-b29a-e69e048e64d2 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:00.068789 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c01df2a9-6a04-49d8-bab9-1f8df5c7f56e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:00.069313 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c01df2a9-6a04-49d8-bab9-1f8df5c7f56e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:00.070116 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c01df2a9-6a04-49d8-bab9-1f8df5c7f56e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:00.070582 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c01df2a9-6a04-49d8-bab9-1f8df5c7f56e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:00.074303 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8679e906-d4d8-48f1-b29a-e69e048e64d2 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:00.074750 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8679e906-d4d8-48f1-b29a-e69e048e64d2 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:00.075513 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8679e906-d4d8-48f1-b29a-e69e048e64d2 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:00.076442 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8679e906-d4d8-48f1-b29a-e69e048e64d2 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:00.080675 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell1:SELECT=100 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:29:00.299049 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-c01df2a9-6a04-49d8-bab9-1f8df5c7f56e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:00.303978 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-8679e906-d4d8-48f1-b29a-e69e048e64d2 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9762ad11e24246aefe2905eafe83f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96b506102ab4528956023c5e0f3dbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:00.306671 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-c01df2a9-6a04-49d8-bab9-1f8df5c7f56e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1321 microversion: 2.1 time: 0.249377 Jun 30 18:29:00.307547 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 54/113] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:00 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1321 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:00.312938 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-2659e21a-486f-4592-b770-bc5b73fa699e tempest-VolumesGetTestJSON-189318919 tempest-VolumesGetTestJSON-189318919-project] Calling method '.version_select at 0x7f18050c88b0>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:00.313617 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-8679e906-d4d8-48f1-b29a-e69e048e64d2 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 200 len: 1314 microversion: 2.1 time: 0.250166 Jun 30 18:29:00.314303 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 60/114] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:00 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:00.319349 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-40eb2726-e8c6-41f6-b2a0-a9f95e7f9c0b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:00.320326 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-40eb2726-e8c6-41f6-b2a0-a9f95e7f9c0b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:00.327250 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-40eb2726-e8c6-41f6-b2a0-a9f95e7f9c0b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:00.327701 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-40eb2726-e8c6-41f6-b2a0-a9f95e7f9c0b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:00.328455 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-40eb2726-e8c6-41f6-b2a0-a9f95e7f9c0b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:00.328885 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-40eb2726-e8c6-41f6-b2a0-a9f95e7f9c0b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:00.378560 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-2659e21a-486f-4592-b770-bc5b73fa699e tempest-VolumesGetTestJSON-189318919 tempest-VolumesGetTestJSON-189318919-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/91d7a266-bf00-43e2-bee6-12d3d04e86e3" status: 200 len: 352 microversion: 2.1 time: 0.069948 Jun 30 18:29:00.379239 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 55/115] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 30 18:29:00 2022] GET /compute/v2.1/os-volumes/91d7a266-bf00-43e2-bee6-12d3d04e86e3 => generated 352 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:29:00.409862 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-40eb2726-e8c6-41f6-b2a0-a9f95e7f9c0b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:00.418601 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-40eb2726-e8c6-41f6-b2a0-a9f95e7f9c0b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:00.420684 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-40eb2726-e8c6-41f6-b2a0-a9f95e7f9c0b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:00.421811 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-40eb2726-e8c6-41f6-b2a0-a9f95e7f9c0b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1340 microversion: 2.20 time: 0.106310 Jun 30 18:29:00.422365 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 61/116] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:29:00 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1340 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:29:01.325352 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-ed957f59-5ad3-4794-846b-6a7144061ff2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:01.326949 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-ed957f59-5ad3-4794-846b-6a7144061ff2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:01.331336 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-bccd6c7d-980f-4472-a803-09b6bb4a12e6 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:01.331947 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-bccd6c7d-980f-4472-a803-09b6bb4a12e6 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:01.333303 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ed957f59-5ad3-4794-846b-6a7144061ff2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:01.333781 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ed957f59-5ad3-4794-846b-6a7144061ff2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:01.334528 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ed957f59-5ad3-4794-846b-6a7144061ff2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:01.334952 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ed957f59-5ad3-4794-846b-6a7144061ff2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:01.337820 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-bccd6c7d-980f-4472-a803-09b6bb4a12e6 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:01.338272 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-bccd6c7d-980f-4472-a803-09b6bb4a12e6 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:01.339035 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-bccd6c7d-980f-4472-a803-09b6bb4a12e6 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:01.339477 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-bccd6c7d-980f-4472-a803-09b6bb4a12e6 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:01.540715 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-ed957f59-5ad3-4794-846b-6a7144061ff2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:01.548025 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-bccd6c7d-980f-4472-a803-09b6bb4a12e6 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9762ad11e24246aefe2905eafe83f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96b506102ab4528956023c5e0f3dbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:01.549377 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-ed957f59-5ad3-4794-846b-6a7144061ff2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1321 microversion: 2.1 time: 0.228396 Jun 30 18:29:01.550399 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 56/117] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:01 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:01.555125 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-6e942e51-457c-4fa6-b3ee-c21c9a6fb120 tempest-VolumesGetTestJSON-189318919 tempest-VolumesGetTestJSON-189318919-project] Calling method '.version_select at 0x7f18059d34c0>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:01.556282 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-bccd6c7d-980f-4472-a803-09b6bb4a12e6 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 200 len: 1314 microversion: 2.1 time: 0.228714 Jun 30 18:29:01.556840 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 62/118] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:01 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:29:01.565370 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-8da2ad99-a43a-4000-a35b-edc9f858b1cd tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:01.566010 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-8da2ad99-a43a-4000-a35b-edc9f858b1cd tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:01.581094 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8da2ad99-a43a-4000-a35b-edc9f858b1cd tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:01.581550 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8da2ad99-a43a-4000-a35b-edc9f858b1cd tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:01.582549 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8da2ad99-a43a-4000-a35b-edc9f858b1cd tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:01.583144 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8da2ad99-a43a-4000-a35b-edc9f858b1cd tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:01.616374 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-6e942e51-457c-4fa6-b3ee-c21c9a6fb120 tempest-VolumesGetTestJSON-189318919 tempest-VolumesGetTestJSON-189318919-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/91d7a266-bf00-43e2-bee6-12d3d04e86e3" status: 200 len: 353 microversion: 2.1 time: 0.064754 Jun 30 18:29:01.617289 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 57/119] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 30 18:29:01 2022] GET /compute/v2.1/os-volumes/91d7a266-bf00-43e2-bee6-12d3d04e86e3 => generated 353 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:29:01.628648 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-44b72f39-7626-4f99-a890-5b7e706385e8 tempest-VolumesGetTestJSON-189318919 tempest-VolumesGetTestJSON-189318919-project] Calling method '.version_select at 0x7f1804fc2040>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:01.654684 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-8da2ad99-a43a-4000-a35b-edc9f858b1cd tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:01.663128 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-8da2ad99-a43a-4000-a35b-edc9f858b1cd tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:01.664631 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-8da2ad99-a43a-4000-a35b-edc9f858b1cd tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:01.665754 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-8da2ad99-a43a-4000-a35b-edc9f858b1cd tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1340 microversion: 2.20 time: 0.107347 Jun 30 18:29:01.666313 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 63/120] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:29:01 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1340 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:29:01.677597 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-44b72f39-7626-4f99-a890-5b7e706385e8 tempest-VolumesGetTestJSON-189318919 tempest-VolumesGetTestJSON-189318919-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/91d7a266-bf00-43e2-bee6-12d3d04e86e3" status: 200 len: 353 microversion: 2.1 time: 0.052517 Jun 30 18:29:01.678177 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 58/121] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 30 18:29:01 2022] GET /compute/v2.1/os-volumes/91d7a266-bf00-43e2-bee6-12d3d04e86e3 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:29:01.693316 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-4082032b-9dcd-4a1b-afa9-8602d0f23b4b tempest-VolumesGetTestJSON-189318919 tempest-VolumesGetTestJSON-189318919-project] Calling method '.version_select at 0x7f18057fc4c0>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:01.753117 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-4082032b-9dcd-4a1b-afa9-8602d0f23b4b tempest-VolumesGetTestJSON-189318919 tempest-VolumesGetTestJSON-189318919-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/91d7a266-bf00-43e2-bee6-12d3d04e86e3" status: 202 len: 0 microversion: 2.1 time: 0.063534 Jun 30 18:29:01.753723 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 64/122] 10.222.0.33 () {58 vars in 1247 bytes} [Thu Jun 30 18:29:01 2022] DELETE /compute/v2.1/os-volumes/91d7a266-bf00-43e2-bee6-12d3d04e86e3 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 18:29:01.762203 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-6cfb3528-1e44-4754-9bbb-66d5292cc47f tempest-VolumesGetTestJSON-189318919 tempest-VolumesGetTestJSON-189318919-project] Calling method '.version_select at 0x7f18050bfe50>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:01.812869 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-6cfb3528-1e44-4754-9bbb-66d5292cc47f tempest-VolumesGetTestJSON-189318919 tempest-VolumesGetTestJSON-189318919-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/91d7a266-bf00-43e2-bee6-12d3d04e86e3" status: 200 len: 352 microversion: 2.1 time: 0.054775 Jun 30 18:29:01.813537 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 59/123] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 30 18:29:01 2022] GET /compute/v2.1/os-volumes/91d7a266-bf00-43e2-bee6-12d3d04e86e3 => generated 352 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:29:02.566105 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-3c38f65b-ff39-4487-9d3b-432f530c64b4 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:02.566713 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-3c38f65b-ff39-4487-9d3b-432f530c64b4 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:02.574357 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-8b429499-1b1d-4dc0-a70a-fcbf61c52aec tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:02.575860 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-8b429499-1b1d-4dc0-a70a-fcbf61c52aec tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:02.576512 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3c38f65b-ff39-4487-9d3b-432f530c64b4 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:02.577074 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3c38f65b-ff39-4487-9d3b-432f530c64b4 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:02.578888 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3c38f65b-ff39-4487-9d3b-432f530c64b4 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:02.579377 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3c38f65b-ff39-4487-9d3b-432f530c64b4 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:02.586203 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8b429499-1b1d-4dc0-a70a-fcbf61c52aec tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:02.587009 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8b429499-1b1d-4dc0-a70a-fcbf61c52aec tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:02.588905 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8b429499-1b1d-4dc0-a70a-fcbf61c52aec tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:02.590445 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8b429499-1b1d-4dc0-a70a-fcbf61c52aec tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:03.119421 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-3c38f65b-ff39-4487-9d3b-432f530c64b4 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:03.129219 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-3c38f65b-ff39-4487-9d3b-432f530c64b4 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1321 microversion: 2.1 time: 0.567307 Jun 30 18:29:03.130471 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 65/124] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:02 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1321 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:03.147832 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-bef148e2-f04d-4345-a6d8-85aca70457d0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:03.148988 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-bef148e2-f04d-4345-a6d8-85aca70457d0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:03.163500 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:29:03.170986 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-bef148e2-f04d-4345-a6d8-85aca70457d0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:03.172523 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-bef148e2-f04d-4345-a6d8-85aca70457d0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:03.176018 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-bef148e2-f04d-4345-a6d8-85aca70457d0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:03.178781 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-bef148e2-f04d-4345-a6d8-85aca70457d0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:03.184928 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-8b429499-1b1d-4dc0-a70a-fcbf61c52aec tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9762ad11e24246aefe2905eafe83f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96b506102ab4528956023c5e0f3dbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:03.198155 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-8b429499-1b1d-4dc0-a70a-fcbf61c52aec tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 200 len: 1314 microversion: 2.1 time: 0.627844 Jun 30 18:29:03.198742 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 60/125] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:02 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 1314 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:03.204078 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-b241583f-1b68-49c1-8fec-29e39715a52b tempest-VolumesGetTestJSON-189318919 tempest-VolumesGetTestJSON-189318919-project] Calling method '.version_select at 0x7f18050c8af0>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:03.367165 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.wsgi [None req-b241583f-1b68-49c1-8fec-29e39715a52b tempest-VolumesGetTestJSON-189318919 tempest-VolumesGetTestJSON-189318919-project] HTTP exception thrown: Volume 91d7a266-bf00-43e2-bee6-12d3d04e86e3 could not be found. Jun 30 18:29:03.369100 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-b241583f-1b68-49c1-8fec-29e39715a52b tempest-VolumesGetTestJSON-189318919 tempest-VolumesGetTestJSON-189318919-project] Request method failure captured: Jun 30 18:29:03.369100 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: request: GET /compute/v2.1/os-volumes/91d7a266-bf00-43e2-bee6-12d3d04e86e3 HTTP/1.1 Jun 30 18:29:03.369100 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept: application/json Jun 30 18:29:03.369100 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept-Encoding: identity Jun 30 18:29:03.369100 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Connection: close Jun 30 18:29:03.369100 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Length: 0 Jun 30 18:29:03.369100 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Type: application/json Jun 30 18:29:03.369100 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Host: 10.222.0.33 Jun 30 18:29:03.369100 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Openstack-System-Scope: None Jun 30 18:29:03.369100 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: User-Agent: python-urllib3/1.26.9 Jun 30 18:29:03.369100 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Auth-Token: gAAAAABivetmK6f8erjXWE5CXubsEDe87i6dsEm_lYrglQBsYDubqc3qs22qNsfPwHMXScPltWXu7DCQAdcD-LMCI6IeMb7iDAbUpVT1mdRZLp96u0kGtEhwT300azMtmJrJrQgir8pUqwDIPqGntDD30mBNMDIqoNU6-vFOrVywbFjxwTdNpEw Jun 30 18:29:03.369100 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Id: None Jun 30 18:29:03.369100 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Name: None Jun 30 18:29:03.369100 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Identity-Status: Confirmed Jun 30 18:29:03.369100 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Is-Admin-Project: True Jun 30 18:29:03.369100 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Id: default Jun 30 18:29:03.369100 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Name: Default Jun 30 18:29:03.369100 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Id: c83e905f79a242d6897cb0bbb4e94712 Jun 30 18:29:03.369100 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Name: tempest-VolumesGetTestJSON-189318919 Jun 30 18:29:03.369100 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Role: reader,member Jun 30 18:29:03.369100 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Roles: reader,member Jun 30 18:29:03.370576 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c83e905f79a242d6897cb0bbb4e94712"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c83e905f79a242d6897cb0bbb4e94712"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c83e905f79a242d6897cb0bbb4e94712"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c83e905f79a242d6897cb0bbb4e94712"}]}] Jun 30 18:29:03.370576 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant: tempest-VolumesGetTestJSON-189318919 Jun 30 18:29:03.370576 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Id: c83e905f79a242d6897cb0bbb4e94712 Jun 30 18:29:03.370576 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Name: tempest-VolumesGetTestJSON-189318919 Jun 30 18:29:03.370576 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User: tempest-VolumesGetTestJSON-189318919-project Jun 30 18:29:03.370576 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Id: default Jun 30 18:29:03.370576 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Name: Default Jun 30 18:29:03.370576 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Id: 46f996ff9e124483ad8dcc0163299159 Jun 30 18:29:03.370576 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Name: tempest-VolumesGetTestJSON-189318919-project Jun 30 18:29:03.370576 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: method: Jun 30 18:29:03.370576 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: exception: Volume 91d7a266-bf00-43e2-bee6-12d3d04e86e3 could not be found. Jun 30 18:29:03.370576 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: action_args: {'id': '91d7a266-bf00-43e2-bee6-12d3d04e86e3'} Jun 30 18:29:03.370576 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:29:03.375150 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:29:03.375150 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 18:29:03.375150 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 18:29:03.375150 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 18:29:03.375150 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 18:29:03.375150 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 18:29:03.375150 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 18:29:03.375150 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 18:29:03.375150 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 18:29:03.375150 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 18:29:03.375150 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 18:29:03.375150 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 18:29:03.375150 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 18:29:03.375150 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 18:29:03.375150 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 18:29:03.375150 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 91d7a266-bf00-43e2-bee6-12d3d04e86e3 could not be found. (HTTP 404) (Request-ID: req-2fd99826-f67b-4d82-bcc7-1c25d29177d4) Jun 30 18:29:03.375150 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:29:03.375150 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:29:03.375150 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:29:03.376406 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:29:03.376406 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 30 18:29:03.376406 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 30 18:29:03.376406 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 18:29:03.376406 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 18:29:03.376406 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 18:29:03.376406 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 18:29:03.376406 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 18:29:03.376406 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 18:29:03.376406 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 18:29:03.376406 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 18:29:03.376406 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 18:29:03.376406 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 18:29:03.376406 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 18:29:03.376406 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 18:29:03.376406 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 18:29:03.376406 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 18:29:03.376406 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 18:29:03.376406 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 18:29:03.377552 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 18:29:03.377552 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 18:29:03.377552 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 18:29:03.377552 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 18:29:03.377552 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 91d7a266-bf00-43e2-bee6-12d3d04e86e3 could not be found. Jun 30 18:29:03.377552 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:29:03.377552 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:29:03.377552 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:29:03.377552 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:29:03.377552 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:29:03.377552 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:29:03.377552 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:29:03.377552 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:29:03.377552 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 18:29:03.377552 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 18:29:03.377552 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:29:03.377552 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:29:03.377552 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 30 18:29:03.377552 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:29:03.378765 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 91d7a266-bf00-43e2-bee6-12d3d04e86e3 could not be found. Jun 30 18:29:03.378765 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:29:03.378765 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:29:03.378765 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:29:03.378765 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:29:03.378765 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:29:03.378765 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:29:03.378765 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:29:03.378765 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:29:03.378765 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 91d7a266-bf00-43e2-bee6-12d3d04e86e3 could not be found. Jun 30 18:29:03.378765 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:29:03.378765 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-b241583f-1b68-49c1-8fec-29e39715a52b tempest-VolumesGetTestJSON-189318919 tempest-VolumesGetTestJSON-189318919-project] Returning 404 to user: Volume 91d7a266-bf00-43e2-bee6-12d3d04e86e3 could not be found. {{(pid=117941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:29:03.378765 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-b241583f-1b68-49c1-8fec-29e39715a52b tempest-VolumesGetTestJSON-189318919 tempest-VolumesGetTestJSON-189318919-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/91d7a266-bf00-43e2-bee6-12d3d04e86e3" status: 404 len: 109 microversion: 2.1 time: 0.170559 Jun 30 18:29:03.378765 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 61/126] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 30 18:29:03 2022] GET /compute/v2.1/os-volumes/91d7a266-bf00-43e2-bee6-12d3d04e86e3 => generated 109 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:29:03.881199 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-bef148e2-f04d-4345-a6d8-85aca70457d0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:03.906528 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-bef148e2-f04d-4345-a6d8-85aca70457d0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:03.913058 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-bef148e2-f04d-4345-a6d8-85aca70457d0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:03.914566 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-bef148e2-f04d-4345-a6d8-85aca70457d0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1407 microversion: 2.20 time: 0.782323 Jun 30 18:29:03.918350 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 66/127] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:29:03 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1407 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:29:04.150507 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-29ac8506-62f3-47c6-8906-bf871c58a78f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:04.151760 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-29ac8506-62f3-47c6-8906-bf871c58a78f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:04.166713 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [req-ab2f220b-724a-4ed4-9f71-f8be2849ce72 req-f0efdcd9-c1b8-4ed2-a89c-9048e481c8d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5df6e0a7-4daa-4bb9-943a-69462fa6bcfd", "tag": "31020119-788a-4b78-a365-ced788236b04"}]} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:29:04.166984 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-29ac8506-62f3-47c6-8906-bf871c58a78f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:04.167624 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-29ac8506-62f3-47c6-8906-bf871c58a78f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:04.168575 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-29ac8506-62f3-47c6-8906-bf871c58a78f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:04.169246 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-29ac8506-62f3-47c6-8906-bf871c58a78f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:04.197327 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-ab2f220b-724a-4ed4-9f71-f8be2849ce72 req-f0efdcd9-c1b8-4ed2-a89c-9048e481c8d7 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:04.198173 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-ab2f220b-724a-4ed4-9f71-f8be2849ce72 req-f0efdcd9-c1b8-4ed2-a89c-9048e481c8d7 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:04.229382 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.compute.server_external_events [req-ab2f220b-724a-4ed4-9f71-f8be2849ce72 req-f0efdcd9-c1b8-4ed2-a89c-9048e481c8d7 service nova] Creating event network-changed:31020119-788a-4b78-a365-ced788236b04 for instance 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd on hv-cinder-80378 Jun 30 18:29:04.234854 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [req-ab2f220b-724a-4ed4-9f71-f8be2849ce72 req-f0efdcd9-c1b8-4ed2-a89c-9048e481c8d7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074322 Jun 30 18:29:04.235815 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 67/128] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:29:04.241172 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-cf5e2557-eda3-461c-825e-44d5c75ef2c9 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:04.241960 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-cf5e2557-eda3-461c-825e-44d5c75ef2c9 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:04.249772 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cf5e2557-eda3-461c-825e-44d5c75ef2c9 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:04.250232 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cf5e2557-eda3-461c-825e-44d5c75ef2c9 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:04.251021 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cf5e2557-eda3-461c-825e-44d5c75ef2c9 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:04.251453 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cf5e2557-eda3-461c-825e-44d5c75ef2c9 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:04.407096 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-29ac8506-62f3-47c6-8906-bf871c58a78f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:04.422794 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-29ac8506-62f3-47c6-8906-bf871c58a78f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1321 microversion: 2.1 time: 0.279117 Jun 30 18:29:04.423629 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 62/129] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:04 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1321 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:04.459494 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-cf5e2557-eda3-461c-825e-44d5c75ef2c9 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9762ad11e24246aefe2905eafe83f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96b506102ab4528956023c5e0f3dbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:04.467423 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-cf5e2557-eda3-461c-825e-44d5c75ef2c9 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 200 len: 1314 microversion: 2.1 time: 0.230448 Jun 30 18:29:04.468263 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 68/130] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:04 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:04.789732 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-499f0008-80c4-4e8d-b320-ed4a35674b1a req-f70e58aa-288f-45c2-964e-dba77b034d6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85c4025a-1510-4b69-a54e-94c9864064b9", "tag": "82ef2cd7-f1a8-48a7-bd5b-c0babc56b244"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:29:04.803813 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-499f0008-80c4-4e8d-b320-ed4a35674b1a req-f70e58aa-288f-45c2-964e-dba77b034d6b service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:04.804654 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-499f0008-80c4-4e8d-b320-ed4a35674b1a req-f70e58aa-288f-45c2-964e-dba77b034d6b service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:04.825856 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.compute.server_external_events [req-499f0008-80c4-4e8d-b320-ed4a35674b1a req-f70e58aa-288f-45c2-964e-dba77b034d6b service nova] Creating event network-changed:82ef2cd7-f1a8-48a7-bd5b-c0babc56b244 for instance 85c4025a-1510-4b69-a54e-94c9864064b9 on hv-cinder-80378 Jun 30 18:29:04.831820 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-499f0008-80c4-4e8d-b320-ed4a35674b1a req-f70e58aa-288f-45c2-964e-dba77b034d6b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046343 Jun 30 18:29:04.832419 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 63/131] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:29:04.934478 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-05cc5314-ff27-4bab-bd40-04155f99c08b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:04.936925 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-05cc5314-ff27-4bab-bd40-04155f99c08b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:04.945694 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-05cc5314-ff27-4bab-bd40-04155f99c08b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:04.947416 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-05cc5314-ff27-4bab-bd40-04155f99c08b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:04.948417 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-05cc5314-ff27-4bab-bd40-04155f99c08b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:04.948870 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-05cc5314-ff27-4bab-bd40-04155f99c08b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:05.157520 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-05cc5314-ff27-4bab-bd40-04155f99c08b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:05.167016 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-05cc5314-ff27-4bab-bd40-04155f99c08b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:05.168873 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-05cc5314-ff27-4bab-bd40-04155f99c08b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:05.170431 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-05cc5314-ff27-4bab-bd40-04155f99c08b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1407 microversion: 2.20 time: 0.240935 Jun 30 18:29:05.170976 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 69/132] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:29:04 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1407 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:29:05.440557 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-65510bb3-c7d5-446b-96db-745f3c9e5dfa tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:05.441246 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-65510bb3-c7d5-446b-96db-745f3c9e5dfa tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:05.448042 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-65510bb3-c7d5-446b-96db-745f3c9e5dfa tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:05.448764 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-65510bb3-c7d5-446b-96db-745f3c9e5dfa tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:05.450148 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-65510bb3-c7d5-446b-96db-745f3c9e5dfa tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:05.451236 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-65510bb3-c7d5-446b-96db-745f3c9e5dfa tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:05.484965 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-8072c672-eb0c-4246-8be1-58303a5506af tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:05.486172 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-8072c672-eb0c-4246-8be1-58303a5506af tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:05.495788 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8072c672-eb0c-4246-8be1-58303a5506af tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:05.496436 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8072c672-eb0c-4246-8be1-58303a5506af tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:05.497370 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8072c672-eb0c-4246-8be1-58303a5506af tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:05.498828 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8072c672-eb0c-4246-8be1-58303a5506af tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:05.677322 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-65510bb3-c7d5-446b-96db-745f3c9e5dfa tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:05.684630 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-65510bb3-c7d5-446b-96db-745f3c9e5dfa tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1321 microversion: 2.1 time: 0.248434 Jun 30 18:29:05.686345 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 64/133] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:05 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1321 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:05.706411 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-8072c672-eb0c-4246-8be1-58303a5506af tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9762ad11e24246aefe2905eafe83f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96b506102ab4528956023c5e0f3dbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:05.715679 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-8072c672-eb0c-4246-8be1-58303a5506af tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 200 len: 1314 microversion: 2.1 time: 0.235661 Jun 30 18:29:05.716948 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 70/134] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:05 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:29:05.969021 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-fb65d3b5-d38f-4698-a3cc-c61db2b52f53 tempest-VolumesNegativeTest-914482515 tempest-VolumesNegativeTest-914482515-project] Action: 'create', calling method: .version_select at 0x7f18050bf700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1344885495", "metadata": {"Type": "work"}}} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:29:05.989097 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-fb65d3b5-d38f-4698-a3cc-c61db2b52f53 tempest-VolumesNegativeTest-914482515 tempest-VolumesNegativeTest-914482515-project] Request method failure captured: Jun 30 18:29:05.989097 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 30 18:29:05.989097 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept: application/json Jun 30 18:29:05.989097 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept-Encoding: identity Jun 30 18:29:05.989097 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Connection: close Jun 30 18:29:05.989097 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Length: 122 Jun 30 18:29:05.989097 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Type: application/json Jun 30 18:29:05.989097 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Host: 10.222.0.33 Jun 30 18:29:05.989097 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Openstack-System-Scope: None Jun 30 18:29:05.989097 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: User-Agent: python-urllib3/1.26.9 Jun 30 18:29:05.989097 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Auth-Token: gAAAAABivetxRef08gBiRicVuTn5NM23-46SjWVuYi0O1L3qIenv4sIf9xhk8gAPJkvuzZW2jh2bDajPh9I2A3e0YgKVyFTIj5fhZgJlP0fYNr_q3E99RrPUPYkkG66e4fJkAFgN2rzMe5RPGLgqGKCDlwI-JGSJfbR9RUeYYFrtLs8iP24CtO8 Jun 30 18:29:05.989097 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Id: None Jun 30 18:29:05.989097 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Name: None Jun 30 18:29:05.989097 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Identity-Status: Confirmed Jun 30 18:29:05.989097 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Is-Admin-Project: True Jun 30 18:29:05.989097 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Id: default Jun 30 18:29:05.989097 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Name: Default Jun 30 18:29:05.989097 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Id: c9fe62c5a48540d69e796f365be164d8 Jun 30 18:29:05.989097 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Name: tempest-VolumesNegativeTest-914482515 Jun 30 18:29:05.989097 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Role: reader,member Jun 30 18:29:05.989097 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Roles: reader,member Jun 30 18:29:05.991615 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c9fe62c5a48540d69e796f365be164d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c9fe62c5a48540d69e796f365be164d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c9fe62c5a48540d69e796f365be164d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c9fe62c5a48540d69e796f365be164d8"}]}] Jun 30 18:29:05.991615 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant: tempest-VolumesNegativeTest-914482515 Jun 30 18:29:05.991615 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Id: c9fe62c5a48540d69e796f365be164d8 Jun 30 18:29:05.991615 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Name: tempest-VolumesNegativeTest-914482515 Jun 30 18:29:05.991615 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User: tempest-VolumesNegativeTest-914482515-project Jun 30 18:29:05.991615 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Id: default Jun 30 18:29:05.991615 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Name: Default Jun 30 18:29:05.991615 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Id: 474e525a853045b3a526b09f4124f032 Jun 30 18:29:05.991615 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Name: tempest-VolumesNegativeTest-914482515-project Jun 30 18:29:05.991615 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Jun 30 18:29:05.991615 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1344885495", "metadata": {"Type": "work"}}} Jun 30 18:29:05.991615 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: method: Jun 30 18:29:05.991615 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 30 18:29:05.992778 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1344885495', 'metadata': {'Type': 'work'}}}} Jun 30 18:29:05.992778 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:29:05.992778 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:29:05.992778 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 30 18:29:05.992778 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 30 18:29:05.992778 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 30 18:29:05.992778 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise error Jun 30 18:29:05.992778 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 30 18:29:05.992778 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:29:05.992778 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 30 18:29:05.992778 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 30 18:29:05.992778 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:29:05.992778 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 30 18:29:05.992778 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi '#$%' Jun 30 18:29:05.992778 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:29:05.992778 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:29:05.992778 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:29:05.992778 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:29:05.992778 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:29:05.992778 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:29:05.992778 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:29:05.992778 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:29:05.996019 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 18:29:05.996019 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 18:29:05.996019 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:29:05.996019 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:29:05.996019 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 30 18:29:05.996019 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 30 18:29:05.996019 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 30 18:29:05.996019 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 30 18:29:05.996019 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 30 18:29:05.996019 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 30 18:29:05.996019 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 30 18:29:05.996019 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:29:05.996019 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:29:05.996019 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:29:05.996019 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:29:05.996019 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:29:05.996019 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:29:05.996019 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 30 18:29:05.996019 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 30 18:29:05.998784 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 30 18:29:05.998784 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:29:06.000165 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-fb65d3b5-d38f-4698-a3cc-c61db2b52f53 tempest-VolumesNegativeTest-914482515 tempest-VolumesNegativeTest-914482515-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:29:06.001166 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-fb65d3b5-d38f-4698-a3cc-c61db2b52f53 tempest-VolumesNegativeTest-914482515 tempest-VolumesNegativeTest-914482515-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.266526 Jun 30 18:29:06.001908 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 65/135] 10.222.0.33 () {60 vars in 1155 bytes} [Thu Jun 30 18:29:05 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 268 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 30 18:29:06.011838 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-475ef427-1373-454f-9fce-25eaf02e7db2 tempest-VolumesNegativeTest-914482515 tempest-VolumesNegativeTest-914482515-project] Action: 'create', calling method: .version_select at 0x7f1805962700>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-783927792", "metadata": {"Type": "work"}}} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:29:06.015358 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-475ef427-1373-454f-9fce-25eaf02e7db2 tempest-VolumesNegativeTest-914482515 tempest-VolumesNegativeTest-914482515-project] Request method failure captured: Jun 30 18:29:06.015358 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 30 18:29:06.015358 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept: application/json Jun 30 18:29:06.015358 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept-Encoding: identity Jun 30 18:29:06.015358 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Connection: close Jun 30 18:29:06.015358 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Length: 119 Jun 30 18:29:06.015358 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Type: application/json Jun 30 18:29:06.015358 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Host: 10.222.0.33 Jun 30 18:29:06.015358 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Openstack-System-Scope: None Jun 30 18:29:06.015358 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: User-Agent: python-urllib3/1.26.9 Jun 30 18:29:06.015358 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Auth-Token: gAAAAABivetxRef08gBiRicVuTn5NM23-46SjWVuYi0O1L3qIenv4sIf9xhk8gAPJkvuzZW2jh2bDajPh9I2A3e0YgKVyFTIj5fhZgJlP0fYNr_q3E99RrPUPYkkG66e4fJkAFgN2rzMe5RPGLgqGKCDlwI-JGSJfbR9RUeYYFrtLs8iP24CtO8 Jun 30 18:29:06.015358 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Id: None Jun 30 18:29:06.015358 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Name: None Jun 30 18:29:06.015358 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Identity-Status: Confirmed Jun 30 18:29:06.015358 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Is-Admin-Project: True Jun 30 18:29:06.015358 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Id: default Jun 30 18:29:06.015358 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Name: Default Jun 30 18:29:06.015358 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Id: c9fe62c5a48540d69e796f365be164d8 Jun 30 18:29:06.015358 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Name: tempest-VolumesNegativeTest-914482515 Jun 30 18:29:06.015358 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Role: reader,member Jun 30 18:29:06.015358 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Roles: reader,member Jun 30 18:29:06.016668 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c9fe62c5a48540d69e796f365be164d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c9fe62c5a48540d69e796f365be164d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c9fe62c5a48540d69e796f365be164d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c9fe62c5a48540d69e796f365be164d8"}]}] Jun 30 18:29:06.016668 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant: tempest-VolumesNegativeTest-914482515 Jun 30 18:29:06.016668 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Id: c9fe62c5a48540d69e796f365be164d8 Jun 30 18:29:06.016668 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Name: tempest-VolumesNegativeTest-914482515 Jun 30 18:29:06.016668 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User: tempest-VolumesNegativeTest-914482515-project Jun 30 18:29:06.016668 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Id: default Jun 30 18:29:06.016668 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Name: Default Jun 30 18:29:06.016668 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Id: 474e525a853045b3a526b09f4124f032 Jun 30 18:29:06.016668 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Name: tempest-VolumesNegativeTest-914482515-project Jun 30 18:29:06.016668 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Jun 30 18:29:06.016668 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-783927792", "metadata": {"Type": "work"}}} Jun 30 18:29:06.016668 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: method: Jun 30 18:29:06.016668 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 30 18:29:06.017440 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-783927792', 'metadata': {'Type': 'work'}}}} Jun 30 18:29:06.017440 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:29:06.017440 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:29:06.017440 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 30 18:29:06.017440 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 30 18:29:06.017440 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 30 18:29:06.017440 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise error Jun 30 18:29:06.017440 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 30 18:29:06.017440 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:29:06.017440 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 30 18:29:06.017440 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 30 18:29:06.017440 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:29:06.017440 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 30 18:29:06.017440 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi '0' Jun 30 18:29:06.017440 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:29:06.017440 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:29:06.017440 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:29:06.017440 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:29:06.017440 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:29:06.017440 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:29:06.017440 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:29:06.017440 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:29:06.018663 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 18:29:06.018663 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 18:29:06.018663 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:29:06.018663 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:29:06.018663 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 30 18:29:06.018663 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 30 18:29:06.018663 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 30 18:29:06.018663 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 30 18:29:06.018663 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 30 18:29:06.018663 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 30 18:29:06.018663 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 30 18:29:06.018663 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:29:06.018663 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:29:06.018663 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:29:06.018663 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:29:06.018663 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:29:06.018663 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:29:06.018663 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 30 18:29:06.018663 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 30 18:29:06.019617 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 30 18:29:06.019617 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:29:06.019617 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-475ef427-1373-454f-9fce-25eaf02e7db2 tempest-VolumesNegativeTest-914482515 tempest-VolumesNegativeTest-914482515-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117940) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:29:06.019617 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-475ef427-1373-454f-9fce-25eaf02e7db2 tempest-VolumesNegativeTest-914482515 tempest-VolumesNegativeTest-914482515-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008863 Jun 30 18:29:06.019617 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 71/136] 10.222.0.33 () {60 vars in 1155 bytes} [Thu Jun 30 18:29:06 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 30 18:29:06.026209 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-05b1797f-eac1-4e31-991e-d5bf3d17c356 tempest-VolumesNegativeTest-914482515 tempest-VolumesNegativeTest-914482515-project] Action: 'create', calling method: .version_select at 0x7f1804fc2550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-964763839", "metadata": {"Type": "work"}}} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:29:06.028504 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-05b1797f-eac1-4e31-991e-d5bf3d17c356 tempest-VolumesNegativeTest-914482515 tempest-VolumesNegativeTest-914482515-project] Request method failure captured: Jun 30 18:29:06.028504 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 30 18:29:06.028504 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept: application/json Jun 30 18:29:06.028504 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept-Encoding: identity Jun 30 18:29:06.028504 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Connection: close Jun 30 18:29:06.028504 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Length: 118 Jun 30 18:29:06.028504 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Type: application/json Jun 30 18:29:06.028504 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Host: 10.222.0.33 Jun 30 18:29:06.028504 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Openstack-System-Scope: None Jun 30 18:29:06.028504 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: User-Agent: python-urllib3/1.26.9 Jun 30 18:29:06.028504 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Auth-Token: gAAAAABivetxRef08gBiRicVuTn5NM23-46SjWVuYi0O1L3qIenv4sIf9xhk8gAPJkvuzZW2jh2bDajPh9I2A3e0YgKVyFTIj5fhZgJlP0fYNr_q3E99RrPUPYkkG66e4fJkAFgN2rzMe5RPGLgqGKCDlwI-JGSJfbR9RUeYYFrtLs8iP24CtO8 Jun 30 18:29:06.028504 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Id: None Jun 30 18:29:06.028504 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Name: None Jun 30 18:29:06.028504 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Identity-Status: Confirmed Jun 30 18:29:06.028504 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Is-Admin-Project: True Jun 30 18:29:06.028504 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Id: default Jun 30 18:29:06.028504 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Name: Default Jun 30 18:29:06.028504 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Id: c9fe62c5a48540d69e796f365be164d8 Jun 30 18:29:06.028504 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Name: tempest-VolumesNegativeTest-914482515 Jun 30 18:29:06.028504 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Role: reader,member Jun 30 18:29:06.028504 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Roles: reader,member Jun 30 18:29:06.030684 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c9fe62c5a48540d69e796f365be164d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c9fe62c5a48540d69e796f365be164d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c9fe62c5a48540d69e796f365be164d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c9fe62c5a48540d69e796f365be164d8"}]}] Jun 30 18:29:06.030684 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant: tempest-VolumesNegativeTest-914482515 Jun 30 18:29:06.030684 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Id: c9fe62c5a48540d69e796f365be164d8 Jun 30 18:29:06.030684 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Name: tempest-VolumesNegativeTest-914482515 Jun 30 18:29:06.030684 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User: tempest-VolumesNegativeTest-914482515-project Jun 30 18:29:06.030684 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Id: default Jun 30 18:29:06.030684 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Name: Default Jun 30 18:29:06.030684 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Id: 474e525a853045b3a526b09f4124f032 Jun 30 18:29:06.030684 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Name: tempest-VolumesNegativeTest-914482515-project Jun 30 18:29:06.030684 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Jun 30 18:29:06.030684 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-964763839", "metadata": {"Type": "work"}}} Jun 30 18:29:06.030684 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: method: Jun 30 18:29:06.030684 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 30 18:29:06.035845 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-964763839', 'metadata': {'Type': 'work'}}}} Jun 30 18:29:06.035845 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:29:06.035845 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:29:06.035845 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 30 18:29:06.035845 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 30 18:29:06.035845 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 30 18:29:06.035845 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise error Jun 30 18:29:06.035845 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 30 18:29:06.035845 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:29:06.035845 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 30 18:29:06.035845 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 30 18:29:06.035845 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:29:06.035845 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 30 18:29:06.035845 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi '' Jun 30 18:29:06.035845 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:29:06.035845 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:29:06.035845 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:29:06.035845 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:29:06.035845 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:29:06.035845 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:29:06.035845 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:29:06.035845 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:29:06.037311 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 18:29:06.037311 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 18:29:06.037311 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:29:06.037311 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:29:06.037311 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 30 18:29:06.037311 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 30 18:29:06.037311 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 30 18:29:06.037311 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 30 18:29:06.037311 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 30 18:29:06.037311 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 30 18:29:06.037311 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 30 18:29:06.037311 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:29:06.037311 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:29:06.037311 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:29:06.037311 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:29:06.037311 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:29:06.037311 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:29:06.037311 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 30 18:29:06.037311 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 30 18:29:06.038469 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 30 18:29:06.038469 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:29:06.038469 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-05b1797f-eac1-4e31-991e-d5bf3d17c356 tempest-VolumesNegativeTest-914482515 tempest-VolumesNegativeTest-914482515-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:29:06.038469 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-05b1797f-eac1-4e31-991e-d5bf3d17c356 tempest-VolumesNegativeTest-914482515 tempest-VolumesNegativeTest-914482515-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007762 Jun 30 18:29:06.038469 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 66/137] 10.222.0.33 () {60 vars in 1155 bytes} [Thu Jun 30 18:29:06 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 30 18:29:06.044121 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-e7fb67b0-5572-45f3-8c26-8317f1e3d9d6 tempest-VolumesNegativeTest-914482515 tempest-VolumesNegativeTest-914482515-project] Calling method '.version_select at 0x7f1805879b80>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:06.090609 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.wsgi [None req-e7fb67b0-5572-45f3-8c26-8317f1e3d9d6 tempest-VolumesNegativeTest-914482515 tempest-VolumesNegativeTest-914482515-project] HTTP exception thrown: Volume tempest-invalid-238548165 could not be found. Jun 30 18:29:06.094570 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-e7fb67b0-5572-45f3-8c26-8317f1e3d9d6 tempest-VolumesNegativeTest-914482515 tempest-VolumesNegativeTest-914482515-project] Request method failure captured: Jun 30 18:29:06.094570 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-238548165 HTTP/1.1 Jun 30 18:29:06.094570 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept: application/json Jun 30 18:29:06.094570 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept-Encoding: identity Jun 30 18:29:06.094570 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Connection: close Jun 30 18:29:06.094570 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Length: 0 Jun 30 18:29:06.094570 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Type: application/json Jun 30 18:29:06.094570 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Host: 10.222.0.33 Jun 30 18:29:06.094570 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Openstack-System-Scope: None Jun 30 18:29:06.094570 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: User-Agent: python-urllib3/1.26.9 Jun 30 18:29:06.094570 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Auth-Token: gAAAAABivetxRef08gBiRicVuTn5NM23-46SjWVuYi0O1L3qIenv4sIf9xhk8gAPJkvuzZW2jh2bDajPh9I2A3e0YgKVyFTIj5fhZgJlP0fYNr_q3E99RrPUPYkkG66e4fJkAFgN2rzMe5RPGLgqGKCDlwI-JGSJfbR9RUeYYFrtLs8iP24CtO8 Jun 30 18:29:06.094570 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Id: None Jun 30 18:29:06.094570 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Name: None Jun 30 18:29:06.094570 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Identity-Status: Confirmed Jun 30 18:29:06.094570 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Is-Admin-Project: True Jun 30 18:29:06.094570 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Id: default Jun 30 18:29:06.094570 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Name: Default Jun 30 18:29:06.094570 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Id: c9fe62c5a48540d69e796f365be164d8 Jun 30 18:29:06.094570 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Name: tempest-VolumesNegativeTest-914482515 Jun 30 18:29:06.094570 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Role: reader,member Jun 30 18:29:06.094570 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Roles: reader,member Jun 30 18:29:06.095968 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c9fe62c5a48540d69e796f365be164d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c9fe62c5a48540d69e796f365be164d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c9fe62c5a48540d69e796f365be164d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c9fe62c5a48540d69e796f365be164d8"}]}] Jun 30 18:29:06.095968 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant: tempest-VolumesNegativeTest-914482515 Jun 30 18:29:06.095968 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Id: c9fe62c5a48540d69e796f365be164d8 Jun 30 18:29:06.095968 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Name: tempest-VolumesNegativeTest-914482515 Jun 30 18:29:06.095968 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User: tempest-VolumesNegativeTest-914482515-project Jun 30 18:29:06.095968 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Id: default Jun 30 18:29:06.095968 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Name: Default Jun 30 18:29:06.095968 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Id: 474e525a853045b3a526b09f4124f032 Jun 30 18:29:06.095968 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Name: tempest-VolumesNegativeTest-914482515-project Jun 30 18:29:06.095968 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: method: Jun 30 18:29:06.095968 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: exception: Volume tempest-invalid-238548165 could not be found. Jun 30 18:29:06.095968 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: action_args: {'id': 'tempest-invalid-238548165'} Jun 30 18:29:06.095968 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:29:06.096850 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:29:06.096850 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 18:29:06.096850 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 18:29:06.096850 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 18:29:06.096850 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 18:29:06.096850 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 18:29:06.096850 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 18:29:06.096850 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 18:29:06.096850 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 18:29:06.096850 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 18:29:06.096850 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 18:29:06.096850 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 18:29:06.096850 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 18:29:06.096850 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 18:29:06.096850 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 18:29:06.096850 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-238548165 could not be found. (HTTP 404) (Request-ID: req-5a2f9ded-341c-49fe-8ccd-80fc821f1776) Jun 30 18:29:06.096850 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:29:06.096850 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:29:06.096850 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:29:06.098148 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:29:06.098148 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 30 18:29:06.098148 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 30 18:29:06.098148 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 18:29:06.098148 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 18:29:06.098148 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 18:29:06.098148 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 18:29:06.098148 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 18:29:06.098148 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 18:29:06.098148 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 18:29:06.098148 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 18:29:06.098148 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 18:29:06.098148 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 18:29:06.098148 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 18:29:06.098148 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 18:29:06.098148 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 18:29:06.098148 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 18:29:06.098148 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 18:29:06.098148 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 18:29:06.099736 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 18:29:06.099736 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 18:29:06.099736 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 18:29:06.099736 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 18:29:06.099736 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-238548165 could not be found. Jun 30 18:29:06.099736 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:29:06.099736 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:29:06.099736 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:29:06.099736 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:29:06.099736 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:29:06.099736 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:29:06.099736 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:29:06.099736 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:29:06.099736 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 18:29:06.099736 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 18:29:06.099736 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:29:06.099736 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:29:06.099736 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 30 18:29:06.099736 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:29:06.099736 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-238548165 could not be found. Jun 30 18:29:06.101393 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:29:06.101393 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:29:06.101393 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:29:06.101393 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:29:06.101393 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:29:06.101393 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:29:06.101393 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:29:06.101393 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:29:06.101393 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-238548165 could not be found. Jun 30 18:29:06.101393 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:29:06.101393 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-e7fb67b0-5572-45f3-8c26-8317f1e3d9d6 tempest-VolumesNegativeTest-914482515 tempest-VolumesNegativeTest-914482515-project] Returning 404 to user: Volume tempest-invalid-238548165 could not be found. {{(pid=117940) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:29:06.101393 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-e7fb67b0-5572-45f3-8c26-8317f1e3d9d6 tempest-VolumesNegativeTest-914482515 tempest-VolumesNegativeTest-914482515-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/tempest-invalid-238548165" status: 404 len: 98 microversion: 2.1 time: 0.056309 Jun 30 18:29:06.101393 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 72/138] 10.222.0.33 () {58 vars in 1214 bytes} [Thu Jun 30 18:29:06 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-238548165 => generated 98 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 30 18:29:06.108541 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-e21bf702-4f97-44b2-8da2-373e23d63a34 tempest-VolumesNegativeTest-914482515 tempest-VolumesNegativeTest-914482515-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004288 Jun 30 18:29:06.109071 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 67/139] 10.222.0.33 () {58 vars in 1139 bytes} [Thu Jun 30 18:29:06 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 30 18:29:06.121920 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-a10c2738-0ccd-406d-9597-5d8eee2dba39 tempest-VolumesNegativeTest-914482515 tempest-VolumesNegativeTest-914482515-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007254 Jun 30 18:29:06.127476 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 73/140] 10.222.0.33 () {58 vars in 1136 bytes} [Thu Jun 30 18:29:06 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 30 18:29:06.132263 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-bbaa3446-c5ff-4e15-ab1b-18a22d0e6083 tempest-VolumesNegativeTest-914482515 tempest-VolumesNegativeTest-914482515-project] Calling method '.version_select at 0x7f18050bf8b0>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:06.161489 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.wsgi [None req-bbaa3446-c5ff-4e15-ab1b-18a22d0e6083 tempest-VolumesNegativeTest-914482515 tempest-VolumesNegativeTest-914482515-project] HTTP exception thrown: Volume 39160fb0-7683-4f16-8ffe-d919565ec80d could not be found. Jun 30 18:29:06.163460 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-bbaa3446-c5ff-4e15-ab1b-18a22d0e6083 tempest-VolumesNegativeTest-914482515 tempest-VolumesNegativeTest-914482515-project] Request method failure captured: Jun 30 18:29:06.163460 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: request: DELETE /compute/v2.1/os-volumes/39160fb0-7683-4f16-8ffe-d919565ec80d HTTP/1.1 Jun 30 18:29:06.163460 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept: application/json Jun 30 18:29:06.163460 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept-Encoding: identity Jun 30 18:29:06.163460 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Connection: close Jun 30 18:29:06.163460 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Length: 0 Jun 30 18:29:06.163460 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Type: application/json Jun 30 18:29:06.163460 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Host: 10.222.0.33 Jun 30 18:29:06.163460 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Openstack-System-Scope: None Jun 30 18:29:06.163460 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: User-Agent: python-urllib3/1.26.9 Jun 30 18:29:06.163460 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Auth-Token: gAAAAABivetxRef08gBiRicVuTn5NM23-46SjWVuYi0O1L3qIenv4sIf9xhk8gAPJkvuzZW2jh2bDajPh9I2A3e0YgKVyFTIj5fhZgJlP0fYNr_q3E99RrPUPYkkG66e4fJkAFgN2rzMe5RPGLgqGKCDlwI-JGSJfbR9RUeYYFrtLs8iP24CtO8 Jun 30 18:29:06.163460 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Id: None Jun 30 18:29:06.163460 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Name: None Jun 30 18:29:06.163460 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Identity-Status: Confirmed Jun 30 18:29:06.163460 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Is-Admin-Project: True Jun 30 18:29:06.163460 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Id: default Jun 30 18:29:06.163460 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Name: Default Jun 30 18:29:06.163460 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Id: c9fe62c5a48540d69e796f365be164d8 Jun 30 18:29:06.163460 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Name: tempest-VolumesNegativeTest-914482515 Jun 30 18:29:06.163460 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Role: reader,member Jun 30 18:29:06.163460 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Roles: reader,member Jun 30 18:29:06.164771 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c9fe62c5a48540d69e796f365be164d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c9fe62c5a48540d69e796f365be164d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c9fe62c5a48540d69e796f365be164d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c9fe62c5a48540d69e796f365be164d8"}]}] Jun 30 18:29:06.164771 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant: tempest-VolumesNegativeTest-914482515 Jun 30 18:29:06.164771 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Id: c9fe62c5a48540d69e796f365be164d8 Jun 30 18:29:06.164771 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Name: tempest-VolumesNegativeTest-914482515 Jun 30 18:29:06.164771 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User: tempest-VolumesNegativeTest-914482515-project Jun 30 18:29:06.164771 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Id: default Jun 30 18:29:06.164771 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Name: Default Jun 30 18:29:06.164771 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Id: 474e525a853045b3a526b09f4124f032 Jun 30 18:29:06.164771 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Name: tempest-VolumesNegativeTest-914482515-project Jun 30 18:29:06.164771 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: method: Jun 30 18:29:06.164771 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: exception: Volume 39160fb0-7683-4f16-8ffe-d919565ec80d could not be found. Jun 30 18:29:06.164771 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: action_args: {'id': '39160fb0-7683-4f16-8ffe-d919565ec80d'} Jun 30 18:29:06.164771 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:29:06.165881 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:29:06.165881 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 18:29:06.165881 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 18:29:06.165881 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 18:29:06.165881 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 18:29:06.165881 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 18:29:06.165881 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 18:29:06.165881 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 18:29:06.165881 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 18:29:06.165881 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 18:29:06.165881 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 18:29:06.165881 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 18:29:06.165881 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 18:29:06.165881 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 18:29:06.165881 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 18:29:06.165881 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 39160fb0-7683-4f16-8ffe-d919565ec80d could not be found. (HTTP 404) (Request-ID: req-8c59d49f-c61e-47be-88cf-85f5bb38b971) Jun 30 18:29:06.165881 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:29:06.165881 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:29:06.165881 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:29:06.166829 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:29:06.166829 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 30 18:29:06.166829 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 30 18:29:06.166829 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 18:29:06.166829 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 18:29:06.166829 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 18:29:06.166829 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 18:29:06.166829 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 18:29:06.166829 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 18:29:06.166829 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 18:29:06.166829 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 18:29:06.166829 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 18:29:06.166829 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 18:29:06.166829 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 18:29:06.166829 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 18:29:06.166829 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 18:29:06.166829 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 18:29:06.166829 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 18:29:06.166829 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 18:29:06.167758 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 18:29:06.167758 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 18:29:06.167758 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 18:29:06.167758 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 18:29:06.167758 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 39160fb0-7683-4f16-8ffe-d919565ec80d could not be found. Jun 30 18:29:06.167758 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:29:06.167758 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:29:06.167758 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:29:06.167758 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:29:06.167758 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:29:06.167758 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:29:06.167758 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:29:06.167758 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:29:06.167758 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 18:29:06.167758 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 18:29:06.167758 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:29:06.167758 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:29:06.167758 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 30 18:29:06.167758 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:29:06.168715 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 39160fb0-7683-4f16-8ffe-d919565ec80d could not be found. Jun 30 18:29:06.168715 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:29:06.168715 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:29:06.168715 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:29:06.168715 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:29:06.168715 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:29:06.168715 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:29:06.168715 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:29:06.168715 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:29:06.168715 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 39160fb0-7683-4f16-8ffe-d919565ec80d could not be found. Jun 30 18:29:06.168715 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:29:06.168715 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-bbaa3446-c5ff-4e15-ab1b-18a22d0e6083 tempest-VolumesNegativeTest-914482515 tempest-VolumesNegativeTest-914482515-project] Returning 404 to user: Volume 39160fb0-7683-4f16-8ffe-d919565ec80d could not be found. {{(pid=117941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:29:06.168715 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-bbaa3446-c5ff-4e15-ab1b-18a22d0e6083 tempest-VolumesNegativeTest-914482515 tempest-VolumesNegativeTest-914482515-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/39160fb0-7683-4f16-8ffe-d919565ec80d" status: 404 len: 109 microversion: 2.1 time: 0.036291 Jun 30 18:29:06.168715 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 68/141] 10.222.0.33 () {58 vars in 1247 bytes} [Thu Jun 30 18:29:06 2022] DELETE /compute/v2.1/os-volumes/39160fb0-7683-4f16-8ffe-d919565ec80d => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:29:06.178127 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-35f035b3-a918-4f74-80b7-4a604ea0c3aa tempest-VolumesNegativeTest-914482515 tempest-VolumesNegativeTest-914482515-project] Calling method '.version_select at 0x7f180592f820>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:06.190471 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-481e87c9-11f7-4fcf-8987-af2ca1fbe0af tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:06.191886 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-481e87c9-11f7-4fcf-8987-af2ca1fbe0af tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:06.201010 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-481e87c9-11f7-4fcf-8987-af2ca1fbe0af tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:06.201882 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-481e87c9-11f7-4fcf-8987-af2ca1fbe0af tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:06.202489 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-481e87c9-11f7-4fcf-8987-af2ca1fbe0af tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:06.202928 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-481e87c9-11f7-4fcf-8987-af2ca1fbe0af tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:06.212203 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.wsgi [None req-35f035b3-a918-4f74-80b7-4a604ea0c3aa tempest-VolumesNegativeTest-914482515 tempest-VolumesNegativeTest-914482515-project] HTTP exception thrown: Volume 3cc0b3aa-16a3-4f13-b463-a560365e7de1 could not be found. Jun 30 18:29:06.214317 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-35f035b3-a918-4f74-80b7-4a604ea0c3aa tempest-VolumesNegativeTest-914482515 tempest-VolumesNegativeTest-914482515-project] Request method failure captured: Jun 30 18:29:06.214317 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: request: GET /compute/v2.1/os-volumes/3cc0b3aa-16a3-4f13-b463-a560365e7de1 HTTP/1.1 Jun 30 18:29:06.214317 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept: application/json Jun 30 18:29:06.214317 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept-Encoding: identity Jun 30 18:29:06.214317 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Connection: close Jun 30 18:29:06.214317 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Length: 0 Jun 30 18:29:06.214317 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Type: application/json Jun 30 18:29:06.214317 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Host: 10.222.0.33 Jun 30 18:29:06.214317 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Openstack-System-Scope: None Jun 30 18:29:06.214317 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: User-Agent: python-urllib3/1.26.9 Jun 30 18:29:06.214317 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Auth-Token: gAAAAABivetxRef08gBiRicVuTn5NM23-46SjWVuYi0O1L3qIenv4sIf9xhk8gAPJkvuzZW2jh2bDajPh9I2A3e0YgKVyFTIj5fhZgJlP0fYNr_q3E99RrPUPYkkG66e4fJkAFgN2rzMe5RPGLgqGKCDlwI-JGSJfbR9RUeYYFrtLs8iP24CtO8 Jun 30 18:29:06.214317 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Id: None Jun 30 18:29:06.214317 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Name: None Jun 30 18:29:06.214317 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Identity-Status: Confirmed Jun 30 18:29:06.214317 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Is-Admin-Project: True Jun 30 18:29:06.214317 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Id: default Jun 30 18:29:06.214317 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Name: Default Jun 30 18:29:06.214317 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Id: c9fe62c5a48540d69e796f365be164d8 Jun 30 18:29:06.214317 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Name: tempest-VolumesNegativeTest-914482515 Jun 30 18:29:06.214317 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Role: reader,member Jun 30 18:29:06.214317 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Roles: reader,member Jun 30 18:29:06.215423 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c9fe62c5a48540d69e796f365be164d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c9fe62c5a48540d69e796f365be164d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c9fe62c5a48540d69e796f365be164d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c9fe62c5a48540d69e796f365be164d8"}]}] Jun 30 18:29:06.215423 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant: tempest-VolumesNegativeTest-914482515 Jun 30 18:29:06.215423 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Id: c9fe62c5a48540d69e796f365be164d8 Jun 30 18:29:06.215423 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Name: tempest-VolumesNegativeTest-914482515 Jun 30 18:29:06.215423 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User: tempest-VolumesNegativeTest-914482515-project Jun 30 18:29:06.215423 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Id: default Jun 30 18:29:06.215423 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Name: Default Jun 30 18:29:06.215423 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Id: 474e525a853045b3a526b09f4124f032 Jun 30 18:29:06.215423 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Name: tempest-VolumesNegativeTest-914482515-project Jun 30 18:29:06.215423 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: method: Jun 30 18:29:06.215423 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: exception: Volume 3cc0b3aa-16a3-4f13-b463-a560365e7de1 could not be found. Jun 30 18:29:06.215423 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: action_args: {'id': '3cc0b3aa-16a3-4f13-b463-a560365e7de1'} Jun 30 18:29:06.215423 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:29:06.216074 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:29:06.216074 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 18:29:06.216074 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 18:29:06.216074 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 18:29:06.216074 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 18:29:06.216074 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 18:29:06.216074 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 18:29:06.216074 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 18:29:06.216074 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 18:29:06.216074 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 18:29:06.216074 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 18:29:06.216074 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 18:29:06.216074 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 18:29:06.216074 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 18:29:06.216074 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 18:29:06.216074 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3cc0b3aa-16a3-4f13-b463-a560365e7de1 could not be found. (HTTP 404) (Request-ID: req-5e8f7bec-7f71-481e-8402-7384d2249ca3) Jun 30 18:29:06.216074 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:29:06.216074 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:29:06.216074 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:29:06.217878 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:29:06.217878 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 30 18:29:06.217878 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 30 18:29:06.217878 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 18:29:06.217878 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 18:29:06.217878 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 18:29:06.217878 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 18:29:06.217878 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 18:29:06.217878 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 18:29:06.217878 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 18:29:06.217878 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 18:29:06.217878 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 18:29:06.217878 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 18:29:06.217878 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 18:29:06.217878 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 18:29:06.217878 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 18:29:06.217878 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 18:29:06.217878 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 18:29:06.217878 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 18:29:06.218813 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 18:29:06.218813 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 18:29:06.218813 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 18:29:06.218813 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 18:29:06.218813 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3cc0b3aa-16a3-4f13-b463-a560365e7de1 could not be found. Jun 30 18:29:06.218813 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:29:06.218813 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:29:06.218813 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:29:06.218813 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:29:06.218813 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:29:06.218813 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:29:06.218813 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:29:06.218813 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:29:06.218813 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 18:29:06.218813 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 18:29:06.218813 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:29:06.218813 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:29:06.218813 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 30 18:29:06.218813 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:29:06.219760 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3cc0b3aa-16a3-4f13-b463-a560365e7de1 could not be found. Jun 30 18:29:06.219760 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:29:06.219760 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:29:06.219760 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:29:06.219760 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:29:06.219760 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:29:06.219760 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:29:06.219760 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:29:06.219760 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:29:06.219760 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3cc0b3aa-16a3-4f13-b463-a560365e7de1 could not be found. Jun 30 18:29:06.219760 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:29:06.219760 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-35f035b3-a918-4f74-80b7-4a604ea0c3aa tempest-VolumesNegativeTest-914482515 tempest-VolumesNegativeTest-914482515-project] Returning 404 to user: Volume 3cc0b3aa-16a3-4f13-b463-a560365e7de1 could not be found. {{(pid=117940) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:29:06.219760 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-35f035b3-a918-4f74-80b7-4a604ea0c3aa tempest-VolumesNegativeTest-914482515 tempest-VolumesNegativeTest-914482515-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/3cc0b3aa-16a3-4f13-b463-a560365e7de1" status: 404 len: 109 microversion: 2.1 time: 0.046631 Jun 30 18:29:06.220412 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 74/142] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 30 18:29:06 2022] GET /compute/v2.1/os-volumes/3cc0b3aa-16a3-4f13-b463-a560365e7de1 => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 30 18:29:06.346832 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-481e87c9-11f7-4fcf-8987-af2ca1fbe0af tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:06.354843 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-481e87c9-11f7-4fcf-8987-af2ca1fbe0af tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:06.356326 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-481e87c9-11f7-4fcf-8987-af2ca1fbe0af tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:06.358001 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-481e87c9-11f7-4fcf-8987-af2ca1fbe0af tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1407 microversion: 2.20 time: 0.172676 Jun 30 18:29:06.358552 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 69/143] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:29:06 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 18:29:06.702977 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-2f76f852-7f47-426c-bece-a2deacd2c4e7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:06.703873 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-2f76f852-7f47-426c-bece-a2deacd2c4e7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:06.712699 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-2f76f852-7f47-426c-bece-a2deacd2c4e7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:06.713546 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-2f76f852-7f47-426c-bece-a2deacd2c4e7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:06.714437 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-2f76f852-7f47-426c-bece-a2deacd2c4e7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:06.715050 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-2f76f852-7f47-426c-bece-a2deacd2c4e7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:06.736093 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-468468e1-57ea-465c-ae65-7dbcd9572cfb tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:06.736942 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-468468e1-57ea-465c-ae65-7dbcd9572cfb tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:06.744548 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-468468e1-57ea-465c-ae65-7dbcd9572cfb tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:06.745198 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-468468e1-57ea-465c-ae65-7dbcd9572cfb tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:06.746431 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-468468e1-57ea-465c-ae65-7dbcd9572cfb tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:06.747133 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-468468e1-57ea-465c-ae65-7dbcd9572cfb tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:06.986664 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-468468e1-57ea-465c-ae65-7dbcd9572cfb tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9762ad11e24246aefe2905eafe83f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96b506102ab4528956023c5e0f3dbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:06.988483 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-2f76f852-7f47-426c-bece-a2deacd2c4e7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:06.996150 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-2f76f852-7f47-426c-bece-a2deacd2c4e7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1321 microversion: 2.1 time: 0.298024 Jun 30 18:29:06.996851 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 75/144] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:06 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1321 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:06.999308 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-468468e1-57ea-465c-ae65-7dbcd9572cfb tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 200 len: 1314 microversion: 2.1 time: 0.268540 Jun 30 18:29:06.999884 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 70/145] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:06 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:07.376030 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-e4b0607d-eca6-4e85-89fe-81f8b3691f3d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:07.376672 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-e4b0607d-eca6-4e85-89fe-81f8b3691f3d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:07.382637 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e4b0607d-eca6-4e85-89fe-81f8b3691f3d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:07.383086 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e4b0607d-eca6-4e85-89fe-81f8b3691f3d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:07.383839 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e4b0607d-eca6-4e85-89fe-81f8b3691f3d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:07.384266 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e4b0607d-eca6-4e85-89fe-81f8b3691f3d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:07.542395 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-e4b0607d-eca6-4e85-89fe-81f8b3691f3d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:07.552427 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-e4b0607d-eca6-4e85-89fe-81f8b3691f3d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:07.553982 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-e4b0607d-eca6-4e85-89fe-81f8b3691f3d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:07.555084 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-e4b0607d-eca6-4e85-89fe-81f8b3691f3d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1407 microversion: 2.20 time: 0.183202 Jun 30 18:29:07.555807 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 76/146] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:29:07 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:29:08.021321 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-ad2b4958-c8da-41fc-bcf6-990909227ce2 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:08.022715 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-ad2b4958-c8da-41fc-bcf6-990909227ce2 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:08.025302 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-bb3e8ba8-fa38-45ee-be7b-06a74a6bf0d7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:08.026642 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-bb3e8ba8-fa38-45ee-be7b-06a74a6bf0d7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:08.035658 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ad2b4958-c8da-41fc-bcf6-990909227ce2 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:08.036209 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-bb3e8ba8-fa38-45ee-be7b-06a74a6bf0d7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:08.036507 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ad2b4958-c8da-41fc-bcf6-990909227ce2 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:08.037415 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-bb3e8ba8-fa38-45ee-be7b-06a74a6bf0d7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:08.037632 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ad2b4958-c8da-41fc-bcf6-990909227ce2 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:08.038273 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ad2b4958-c8da-41fc-bcf6-990909227ce2 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:08.038729 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-bb3e8ba8-fa38-45ee-be7b-06a74a6bf0d7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:08.039241 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-bb3e8ba8-fa38-45ee-be7b-06a74a6bf0d7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:08.317005 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-bb3e8ba8-fa38-45ee-be7b-06a74a6bf0d7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:08.320885 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-ad2b4958-c8da-41fc-bcf6-990909227ce2 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9762ad11e24246aefe2905eafe83f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96b506102ab4528956023c5e0f3dbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:08.327580 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-bb3e8ba8-fa38-45ee-be7b-06a74a6bf0d7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1321 microversion: 2.1 time: 0.307360 Jun 30 18:29:08.331728 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 77/147] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:08 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1321 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:29:08.351673 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-ad2b4958-c8da-41fc-bcf6-990909227ce2 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 200 len: 1314 microversion: 2.1 time: 0.334390 Jun 30 18:29:08.361223 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 71/148] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:08 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:29:08.582489 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-8c252aae-2bb5-4e51-bc85-9e35ee05ba98 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:08.584134 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-8c252aae-2bb5-4e51-bc85-9e35ee05ba98 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:08.595053 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8c252aae-2bb5-4e51-bc85-9e35ee05ba98 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:08.596026 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8c252aae-2bb5-4e51-bc85-9e35ee05ba98 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:08.598230 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8c252aae-2bb5-4e51-bc85-9e35ee05ba98 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:08.598895 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8c252aae-2bb5-4e51-bc85-9e35ee05ba98 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:09.303782 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-8c252aae-2bb5-4e51-bc85-9e35ee05ba98 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:09.314777 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-8c252aae-2bb5-4e51-bc85-9e35ee05ba98 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:09.318212 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-8c252aae-2bb5-4e51-bc85-9e35ee05ba98 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:09.321123 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-8c252aae-2bb5-4e51-bc85-9e35ee05ba98 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1407 microversion: 2.20 time: 0.749625 Jun 30 18:29:09.323109 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 78/149] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:29:08 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1407 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:29:09.346739 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-f5fc2acb-3365-422d-b929-bea493f21e3b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:09.347325 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-f5fc2acb-3365-422d-b929-bea493f21e3b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:09.358894 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f5fc2acb-3365-422d-b929-bea493f21e3b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:09.359352 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f5fc2acb-3365-422d-b929-bea493f21e3b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:09.360136 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f5fc2acb-3365-422d-b929-bea493f21e3b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:09.360564 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f5fc2acb-3365-422d-b929-bea493f21e3b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:09.376932 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-cbac8042-b779-46a7-bcad-0970a3002208 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:09.377554 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-cbac8042-b779-46a7-bcad-0970a3002208 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:09.400556 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cbac8042-b779-46a7-bcad-0970a3002208 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:09.401131 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cbac8042-b779-46a7-bcad-0970a3002208 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:09.407735 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cbac8042-b779-46a7-bcad-0970a3002208 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:09.408185 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cbac8042-b779-46a7-bcad-0970a3002208 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:09.846189 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-f5fc2acb-3365-422d-b929-bea493f21e3b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:09.869051 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-cbac8042-b779-46a7-bcad-0970a3002208 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9762ad11e24246aefe2905eafe83f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96b506102ab4528956023c5e0f3dbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:09.874879 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-f5fc2acb-3365-422d-b929-bea493f21e3b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1321 microversion: 2.1 time: 0.520667 Jun 30 18:29:09.880149 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 72/150] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:09 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1321 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:09.888143 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-cbac8042-b779-46a7-bcad-0970a3002208 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 200 len: 1314 microversion: 2.1 time: 0.518631 Jun 30 18:29:09.891879 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 79/151] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:09 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 1314 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:10.341892 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-2d6e2a93-126e-4553-94d7-17e866eaa5d7 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:10.342912 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-2d6e2a93-126e-4553-94d7-17e866eaa5d7 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:10.349212 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2d6e2a93-126e-4553-94d7-17e866eaa5d7 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:10.350345 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2d6e2a93-126e-4553-94d7-17e866eaa5d7 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:10.351268 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2d6e2a93-126e-4553-94d7-17e866eaa5d7 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:10.351841 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2d6e2a93-126e-4553-94d7-17e866eaa5d7 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:10.525620 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-2d6e2a93-126e-4553-94d7-17e866eaa5d7 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:10.531834 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-2d6e2a93-126e-4553-94d7-17e866eaa5d7 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:10.533310 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-2d6e2a93-126e-4553-94d7-17e866eaa5d7 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:10.535072 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-2d6e2a93-126e-4553-94d7-17e866eaa5d7 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1407 microversion: 2.20 time: 0.198022 Jun 30 18:29:10.535635 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 73/152] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:29:10 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:29:10.895672 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-3fb87f91-d45a-4cc8-9ed3-925e554fdd9a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:10.896272 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-3fb87f91-d45a-4cc8-9ed3-925e554fdd9a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:10.902563 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3fb87f91-d45a-4cc8-9ed3-925e554fdd9a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:10.903014 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3fb87f91-d45a-4cc8-9ed3-925e554fdd9a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:10.903775 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3fb87f91-d45a-4cc8-9ed3-925e554fdd9a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:10.905142 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3fb87f91-d45a-4cc8-9ed3-925e554fdd9a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:10.912824 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-ec236fe0-2637-4c7a-b309-e89810945678 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:10.913600 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-ec236fe0-2637-4c7a-b309-e89810945678 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:10.925923 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ec236fe0-2637-4c7a-b309-e89810945678 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:10.926386 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ec236fe0-2637-4c7a-b309-e89810945678 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:10.929171 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ec236fe0-2637-4c7a-b309-e89810945678 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:10.929829 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ec236fe0-2637-4c7a-b309-e89810945678 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:11.221757 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-3fb87f91-d45a-4cc8-9ed3-925e554fdd9a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:11.234303 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-3fb87f91-d45a-4cc8-9ed3-925e554fdd9a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1321 microversion: 2.1 time: 0.342129 Jun 30 18:29:11.235346 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 80/153] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:10 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1321 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:29:11.272770 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-ec236fe0-2637-4c7a-b309-e89810945678 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9762ad11e24246aefe2905eafe83f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96b506102ab4528956023c5e0f3dbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:11.281878 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-ec236fe0-2637-4c7a-b309-e89810945678 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 200 len: 1314 microversion: 2.1 time: 0.374712 Jun 30 18:29:11.283514 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 74/154] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:10 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:29:11.554590 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-ea93a1fa-60c9-4512-a120-2ae8d9fed920 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:11.555895 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-ea93a1fa-60c9-4512-a120-2ae8d9fed920 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:11.566401 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ea93a1fa-60c9-4512-a120-2ae8d9fed920 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:11.566917 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ea93a1fa-60c9-4512-a120-2ae8d9fed920 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:11.567936 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ea93a1fa-60c9-4512-a120-2ae8d9fed920 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:11.568558 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ea93a1fa-60c9-4512-a120-2ae8d9fed920 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:11.723812 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-ea93a1fa-60c9-4512-a120-2ae8d9fed920 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:11.736126 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-ea93a1fa-60c9-4512-a120-2ae8d9fed920 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:11.738424 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-ea93a1fa-60c9-4512-a120-2ae8d9fed920 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:11.739546 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-ea93a1fa-60c9-4512-a120-2ae8d9fed920 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1407 microversion: 2.20 time: 0.189472 Jun 30 18:29:11.740096 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 81/155] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:29:11 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:29:12.251918 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-495164e3-1215-47dd-9f39-7b7a69c9ffb7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:12.252455 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-495164e3-1215-47dd-9f39-7b7a69c9ffb7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:12.258422 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-495164e3-1215-47dd-9f39-7b7a69c9ffb7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:12.258865 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-495164e3-1215-47dd-9f39-7b7a69c9ffb7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:12.259614 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-495164e3-1215-47dd-9f39-7b7a69c9ffb7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:12.260043 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-495164e3-1215-47dd-9f39-7b7a69c9ffb7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:12.299977 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-ef752d43-321b-4472-96eb-fb8d7d51c7ad tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:12.300576 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-ef752d43-321b-4472-96eb-fb8d7d51c7ad tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:12.307236 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ef752d43-321b-4472-96eb-fb8d7d51c7ad tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:12.307701 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ef752d43-321b-4472-96eb-fb8d7d51c7ad tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:12.308451 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ef752d43-321b-4472-96eb-fb8d7d51c7ad tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:12.308879 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ef752d43-321b-4472-96eb-fb8d7d51c7ad tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:12.330170 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell1:SELECT=100 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:29:12.455911 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-495164e3-1215-47dd-9f39-7b7a69c9ffb7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:12.466236 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-495164e3-1215-47dd-9f39-7b7a69c9ffb7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1321 microversion: 2.1 time: 0.218721 Jun 30 18:29:12.468151 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 75/156] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:12 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:29:12.487616 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-ef752d43-321b-4472-96eb-fb8d7d51c7ad tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9762ad11e24246aefe2905eafe83f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96b506102ab4528956023c5e0f3dbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:12.497404 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-ef752d43-321b-4472-96eb-fb8d7d51c7ad tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 200 len: 1314 microversion: 2.1 time: 0.201039 Jun 30 18:29:12.498225 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 82/157] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:12 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:12.758475 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-98aff68c-84a5-487e-8a4b-7e3223ac16ec tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:12.759777 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-98aff68c-84a5-487e-8a4b-7e3223ac16ec tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:12.766162 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-98aff68c-84a5-487e-8a4b-7e3223ac16ec tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:12.766613 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-98aff68c-84a5-487e-8a4b-7e3223ac16ec tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:12.767364 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-98aff68c-84a5-487e-8a4b-7e3223ac16ec tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:12.767792 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-98aff68c-84a5-487e-8a4b-7e3223ac16ec tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:12.771782 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell1:SELECT=100 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:29:12.899374 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-98aff68c-84a5-487e-8a4b-7e3223ac16ec tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:12.908061 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-98aff68c-84a5-487e-8a4b-7e3223ac16ec tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:12.909553 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-98aff68c-84a5-487e-8a4b-7e3223ac16ec tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:12.910667 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-98aff68c-84a5-487e-8a4b-7e3223ac16ec tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1407 microversion: 2.20 time: 0.156182 Jun 30 18:29:12.911231 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 76/158] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:29:12 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:29:13.486828 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-3faf11f4-0175-425a-b280-c1ece4610c23 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:13.487425 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-3faf11f4-0175-425a-b280-c1ece4610c23 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:13.494432 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3faf11f4-0175-425a-b280-c1ece4610c23 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:13.494981 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3faf11f4-0175-425a-b280-c1ece4610c23 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:13.495735 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3faf11f4-0175-425a-b280-c1ece4610c23 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:13.496232 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3faf11f4-0175-425a-b280-c1ece4610c23 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:13.519247 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-046cf5a3-d979-4c7e-b67d-008114b5af97 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:13.519796 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-046cf5a3-d979-4c7e-b67d-008114b5af97 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:13.525860 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-046cf5a3-d979-4c7e-b67d-008114b5af97 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:13.526313 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-046cf5a3-d979-4c7e-b67d-008114b5af97 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:13.527080 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-046cf5a3-d979-4c7e-b67d-008114b5af97 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:13.527517 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-046cf5a3-d979-4c7e-b67d-008114b5af97 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:13.694440 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-3faf11f4-0175-425a-b280-c1ece4610c23 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:13.703801 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-3faf11f4-0175-425a-b280-c1ece4610c23 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1321 microversion: 2.1 time: 0.221353 Jun 30 18:29:13.704570 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 83/159] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:13 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1321 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:13.720877 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-046cf5a3-d979-4c7e-b67d-008114b5af97 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9762ad11e24246aefe2905eafe83f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96b506102ab4528956023c5e0f3dbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:13.728494 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-046cf5a3-d979-4c7e-b67d-008114b5af97 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 200 len: 1314 microversion: 2.1 time: 0.214551 Jun 30 18:29:13.729061 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 77/160] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:13 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:29:13.928102 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-fc4fa3cd-b44a-4dca-ae14-a375461ec481 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:13.928830 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-fc4fa3cd-b44a-4dca-ae14-a375461ec481 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:13.934834 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fc4fa3cd-b44a-4dca-ae14-a375461ec481 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:13.935763 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fc4fa3cd-b44a-4dca-ae14-a375461ec481 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:13.936819 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fc4fa3cd-b44a-4dca-ae14-a375461ec481 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:13.937536 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fc4fa3cd-b44a-4dca-ae14-a375461ec481 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:14.072718 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-fc4fa3cd-b44a-4dca-ae14-a375461ec481 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:14.081734 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-fc4fa3cd-b44a-4dca-ae14-a375461ec481 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:14.083311 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-fc4fa3cd-b44a-4dca-ae14-a375461ec481 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:14.084810 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-fc4fa3cd-b44a-4dca-ae14-a375461ec481 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1407 microversion: 2.20 time: 0.160410 Jun 30 18:29:14.085520 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 84/161] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:29:13 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:29:14.720750 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-937a8612-0505-4cda-8d08-130f05502fed tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:14.721419 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-937a8612-0505-4cda-8d08-130f05502fed tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:14.730336 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-937a8612-0505-4cda-8d08-130f05502fed tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:14.731086 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-937a8612-0505-4cda-8d08-130f05502fed tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:14.732015 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-937a8612-0505-4cda-8d08-130f05502fed tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:14.734064 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-937a8612-0505-4cda-8d08-130f05502fed tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:14.747438 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-babb0a01-b8f8-47e5-a669-80e19bef181a tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:14.747990 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-babb0a01-b8f8-47e5-a669-80e19bef181a tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:14.754792 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-babb0a01-b8f8-47e5-a669-80e19bef181a tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:14.755235 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-babb0a01-b8f8-47e5-a669-80e19bef181a tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:14.755994 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-babb0a01-b8f8-47e5-a669-80e19bef181a tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:14.756423 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-babb0a01-b8f8-47e5-a669-80e19bef181a tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:14.944285 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-937a8612-0505-4cda-8d08-130f05502fed tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:14.952846 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-babb0a01-b8f8-47e5-a669-80e19bef181a tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9762ad11e24246aefe2905eafe83f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96b506102ab4528956023c5e0f3dbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:14.954927 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-937a8612-0505-4cda-8d08-130f05502fed tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1321 microversion: 2.1 time: 0.238601 Jun 30 18:29:14.961852 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-babb0a01-b8f8-47e5-a669-80e19bef181a tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 200 len: 1314 microversion: 2.1 time: 0.219880 Jun 30 18:29:14.962487 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 85/162] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:14 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:29:14.965642 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 78/163] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:14 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1321 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:15.103075 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-3c50e309-f8b1-4193-9951-157362339fe3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:15.103680 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-3c50e309-f8b1-4193-9951-157362339fe3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:15.109976 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3c50e309-f8b1-4193-9951-157362339fe3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:15.110421 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3c50e309-f8b1-4193-9951-157362339fe3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:15.111178 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3c50e309-f8b1-4193-9951-157362339fe3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:15.111611 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3c50e309-f8b1-4193-9951-157362339fe3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:15.292164 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-3c50e309-f8b1-4193-9951-157362339fe3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:15.302335 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-3c50e309-f8b1-4193-9951-157362339fe3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:15.304092 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-3c50e309-f8b1-4193-9951-157362339fe3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:15.305368 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-3c50e309-f8b1-4193-9951-157362339fe3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1407 microversion: 2.20 time: 0.206217 Jun 30 18:29:15.305945 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 86/164] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:29:15 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:29:15.973296 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-5d0dd7f8-fa99-45ad-95ab-b3aa70a48538 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:15.973932 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-5d0dd7f8-fa99-45ad-95ab-b3aa70a48538 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:15.980900 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-5d0dd7f8-fa99-45ad-95ab-b3aa70a48538 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:15.981425 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-5d0dd7f8-fa99-45ad-95ab-b3aa70a48538 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:15.982442 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-5d0dd7f8-fa99-45ad-95ab-b3aa70a48538 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:15.983434 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-5d0dd7f8-fa99-45ad-95ab-b3aa70a48538 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:15.984311 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-1c2c3095-348d-4afe-b2c5-95813cd59838 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:15.984923 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-1c2c3095-348d-4afe-b2c5-95813cd59838 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:15.992808 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-1c2c3095-348d-4afe-b2c5-95813cd59838 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:15.993488 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-1c2c3095-348d-4afe-b2c5-95813cd59838 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:15.994487 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-1c2c3095-348d-4afe-b2c5-95813cd59838 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:15.995097 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-1c2c3095-348d-4afe-b2c5-95813cd59838 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:16.183082 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-5d0dd7f8-fa99-45ad-95ab-b3aa70a48538 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:16.190784 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-1c2c3095-348d-4afe-b2c5-95813cd59838 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9762ad11e24246aefe2905eafe83f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96b506102ab4528956023c5e0f3dbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:16.192065 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-5d0dd7f8-fa99-45ad-95ab-b3aa70a48538 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1321 microversion: 2.1 time: 0.222516 Jun 30 18:29:16.192746 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 79/165] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:15 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:16.201469 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-1c2c3095-348d-4afe-b2c5-95813cd59838 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 200 len: 1314 microversion: 2.1 time: 0.221972 Jun 30 18:29:16.202340 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 87/166] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:15 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:29:16.323135 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-b1e62f2e-a0b3-47ef-b6cb-43b4e5f458b3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:16.323739 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-b1e62f2e-a0b3-47ef-b6cb-43b4e5f458b3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:16.336612 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b1e62f2e-a0b3-47ef-b6cb-43b4e5f458b3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:16.337288 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b1e62f2e-a0b3-47ef-b6cb-43b4e5f458b3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:16.338230 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b1e62f2e-a0b3-47ef-b6cb-43b4e5f458b3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:16.339396 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b1e62f2e-a0b3-47ef-b6cb-43b4e5f458b3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:16.651287 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-b1e62f2e-a0b3-47ef-b6cb-43b4e5f458b3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:16.661923 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-b1e62f2e-a0b3-47ef-b6cb-43b4e5f458b3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:16.664336 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-b1e62f2e-a0b3-47ef-b6cb-43b4e5f458b3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:16.665826 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-b1e62f2e-a0b3-47ef-b6cb-43b4e5f458b3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1407 microversion: 2.20 time: 0.346486 Jun 30 18:29:16.666921 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 80/167] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:29:16 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1407 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:29:17.208081 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-8871b441-6ea7-4e19-a2bd-3255806bf044 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:17.208688 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-8871b441-6ea7-4e19-a2bd-3255806bf044 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:17.216721 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8871b441-6ea7-4e19-a2bd-3255806bf044 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:17.217784 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8871b441-6ea7-4e19-a2bd-3255806bf044 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:17.218549 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-02d8fa21-fbc7-45e9-99ec-cc21f32b9727 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:17.219166 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-02d8fa21-fbc7-45e9-99ec-cc21f32b9727 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:17.219363 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8871b441-6ea7-4e19-a2bd-3255806bf044 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:17.220555 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8871b441-6ea7-4e19-a2bd-3255806bf044 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:17.225386 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-02d8fa21-fbc7-45e9-99ec-cc21f32b9727 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:17.225863 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-02d8fa21-fbc7-45e9-99ec-cc21f32b9727 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:17.226637 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-02d8fa21-fbc7-45e9-99ec-cc21f32b9727 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:17.227066 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-02d8fa21-fbc7-45e9-99ec-cc21f32b9727 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:17.429274 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-8871b441-6ea7-4e19-a2bd-3255806bf044 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:17.432950 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-02d8fa21-fbc7-45e9-99ec-cc21f32b9727 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9762ad11e24246aefe2905eafe83f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96b506102ab4528956023c5e0f3dbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:17.437868 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-8871b441-6ea7-4e19-a2bd-3255806bf044 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1321 microversion: 2.1 time: 0.233561 Jun 30 18:29:17.438668 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 88/168] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:17 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1321 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:17.441885 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-02d8fa21-fbc7-45e9-99ec-cc21f32b9727 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 200 len: 1314 microversion: 2.1 time: 0.227149 Jun 30 18:29:17.442721 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 81/169] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:17 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:29:17.683743 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-77f48b6e-d87d-450f-bebd-70a7c10904c1 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:17.684276 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-77f48b6e-d87d-450f-bebd-70a7c10904c1 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:17.692212 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-77f48b6e-d87d-450f-bebd-70a7c10904c1 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:17.692649 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-77f48b6e-d87d-450f-bebd-70a7c10904c1 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:17.693401 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-77f48b6e-d87d-450f-bebd-70a7c10904c1 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:17.693854 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-77f48b6e-d87d-450f-bebd-70a7c10904c1 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:17.830060 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-77f48b6e-d87d-450f-bebd-70a7c10904c1 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:17.837869 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-77f48b6e-d87d-450f-bebd-70a7c10904c1 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:17.839351 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-77f48b6e-d87d-450f-bebd-70a7c10904c1 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:17.840432 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-77f48b6e-d87d-450f-bebd-70a7c10904c1 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1407 microversion: 2.20 time: 0.160538 Jun 30 18:29:17.840977 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 89/170] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:29:17 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:29:18.455319 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-fb2cbb0d-e0ca-47f4-be99-d1a01d9a3846 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:18.455936 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-fb2cbb0d-e0ca-47f4-be99-d1a01d9a3846 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:18.459722 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-b85d8424-1006-467a-9677-9f8acd8b31ab tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:18.460353 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-b85d8424-1006-467a-9677-9f8acd8b31ab tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:18.462151 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fb2cbb0d-e0ca-47f4-be99-d1a01d9a3846 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:18.462598 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fb2cbb0d-e0ca-47f4-be99-d1a01d9a3846 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:18.463362 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fb2cbb0d-e0ca-47f4-be99-d1a01d9a3846 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:18.463793 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fb2cbb0d-e0ca-47f4-be99-d1a01d9a3846 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:18.466449 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b85d8424-1006-467a-9677-9f8acd8b31ab tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:18.467465 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b85d8424-1006-467a-9677-9f8acd8b31ab tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:18.468294 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b85d8424-1006-467a-9677-9f8acd8b31ab tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:18.468939 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b85d8424-1006-467a-9677-9f8acd8b31ab tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:18.712789 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-fb2cbb0d-e0ca-47f4-be99-d1a01d9a3846 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:18.719027 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-b85d8424-1006-467a-9677-9f8acd8b31ab tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9762ad11e24246aefe2905eafe83f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96b506102ab4528956023c5e0f3dbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:18.720447 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-fb2cbb0d-e0ca-47f4-be99-d1a01d9a3846 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1321 microversion: 2.1 time: 0.269565 Jun 30 18:29:18.721030 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 82/171] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:18 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1321 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:18.737412 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-b85d8424-1006-467a-9677-9f8acd8b31ab tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 200 len: 1314 microversion: 2.1 time: 0.281942 Jun 30 18:29:18.738000 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 90/172] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:18 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:29:18.859672 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-00cdc1aa-8025-4909-b93e-a9ff83475579 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:18.860268 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-00cdc1aa-8025-4909-b93e-a9ff83475579 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:18.866164 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-00cdc1aa-8025-4909-b93e-a9ff83475579 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:18.866599 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-00cdc1aa-8025-4909-b93e-a9ff83475579 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:18.867340 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-00cdc1aa-8025-4909-b93e-a9ff83475579 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:18.867760 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-00cdc1aa-8025-4909-b93e-a9ff83475579 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:19.179104 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-00cdc1aa-8025-4909-b93e-a9ff83475579 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:19.203605 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-00cdc1aa-8025-4909-b93e-a9ff83475579 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:19.205378 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-00cdc1aa-8025-4909-b93e-a9ff83475579 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:19.206732 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-00cdc1aa-8025-4909-b93e-a9ff83475579 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1407 microversion: 2.20 time: 0.351136 Jun 30 18:29:19.207710 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 83/173] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:29:18 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1407 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:29:19.740944 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-29573984-b6b9-4fbc-993a-b75deb9e4195 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:19.741905 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-29573984-b6b9-4fbc-993a-b75deb9e4195 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:19.751107 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-29573984-b6b9-4fbc-993a-b75deb9e4195 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:19.751668 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-29573984-b6b9-4fbc-993a-b75deb9e4195 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:19.752530 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-29573984-b6b9-4fbc-993a-b75deb9e4195 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:19.753058 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-29573984-b6b9-4fbc-993a-b75deb9e4195 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:19.758491 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-81af230b-6f5a-43b9-9bb4-362a2eb082d5 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:19.758491 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-81af230b-6f5a-43b9-9bb4-362a2eb082d5 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:19.764872 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-81af230b-6f5a-43b9-9bb4-362a2eb082d5 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:19.765309 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-81af230b-6f5a-43b9-9bb4-362a2eb082d5 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:19.766835 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-81af230b-6f5a-43b9-9bb4-362a2eb082d5 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:19.767265 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-81af230b-6f5a-43b9-9bb4-362a2eb082d5 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:19.981907 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-29573984-b6b9-4fbc-993a-b75deb9e4195 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:19.989349 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-81af230b-6f5a-43b9-9bb4-362a2eb082d5 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9762ad11e24246aefe2905eafe83f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96b506102ab4528956023c5e0f3dbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:19.994894 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-29573984-b6b9-4fbc-993a-b75deb9e4195 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1321 microversion: 2.1 time: 0.254493 Jun 30 18:29:19.994894 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 91/174] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:19 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1321 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:19.996732 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-81af230b-6f5a-43b9-9bb4-362a2eb082d5 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 200 len: 1314 microversion: 2.1 time: 0.244759 Jun 30 18:29:19.997288 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 84/175] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:19 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:20.226123 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-ff6cf128-f575-43a1-b38c-7b348b833a34 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:20.226846 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-ff6cf128-f575-43a1-b38c-7b348b833a34 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:20.236602 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ff6cf128-f575-43a1-b38c-7b348b833a34 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:20.237374 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ff6cf128-f575-43a1-b38c-7b348b833a34 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:20.238295 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ff6cf128-f575-43a1-b38c-7b348b833a34 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:20.238703 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ff6cf128-f575-43a1-b38c-7b348b833a34 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:20.381105 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-ff6cf128-f575-43a1-b38c-7b348b833a34 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:20.389876 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-ff6cf128-f575-43a1-b38c-7b348b833a34 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:20.391419 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-ff6cf128-f575-43a1-b38c-7b348b833a34 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:20.392504 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-ff6cf128-f575-43a1-b38c-7b348b833a34 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1407 microversion: 2.20 time: 0.171853 Jun 30 18:29:20.393053 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 92/176] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:29:20 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:29:21.006999 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-dd17be83-c4d9-493b-9c41-61ae136bf420 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:21.007837 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-dd17be83-c4d9-493b-9c41-61ae136bf420 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:21.010968 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_api:SELECT=63 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:29:21.013872 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-2ed2b8b0-d958-4b27-961a-ff1db141dadd tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:21.015028 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-2ed2b8b0-d958-4b27-961a-ff1db141dadd tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:21.015329 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-dd17be83-c4d9-493b-9c41-61ae136bf420 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:21.015839 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-dd17be83-c4d9-493b-9c41-61ae136bf420 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:21.016683 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-dd17be83-c4d9-493b-9c41-61ae136bf420 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:21.017177 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-dd17be83-c4d9-493b-9c41-61ae136bf420 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:21.020951 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-2ed2b8b0-d958-4b27-961a-ff1db141dadd tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:21.027258 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-2ed2b8b0-d958-4b27-961a-ff1db141dadd tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:21.028475 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-2ed2b8b0-d958-4b27-961a-ff1db141dadd tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:21.030438 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-2ed2b8b0-d958-4b27-961a-ff1db141dadd tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:21.418707 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-dd17be83-c4d9-493b-9c41-61ae136bf420 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:21.422697 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-2ed2b8b0-d958-4b27-961a-ff1db141dadd tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9762ad11e24246aefe2905eafe83f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96b506102ab4528956023c5e0f3dbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:21.427340 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-dd17be83-c4d9-493b-9c41-61ae136bf420 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1321 microversion: 2.1 time: 0.424077 Jun 30 18:29:21.427932 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 85/177] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:21 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1321 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:21.432407 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-83ddc8a7-034b-4597-9bbc-ea884ae318eb tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:21.432764 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-2ed2b8b0-d958-4b27-961a-ff1db141dadd tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 200 len: 1314 microversion: 2.1 time: 0.423012 Jun 30 18:29:21.433007 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-83ddc8a7-034b-4597-9bbc-ea884ae318eb tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:21.436351 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 93/178] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:21 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:29:21.439872 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-83ddc8a7-034b-4597-9bbc-ea884ae318eb tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:21.440317 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-83ddc8a7-034b-4597-9bbc-ea884ae318eb tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:21.441406 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-83ddc8a7-034b-4597-9bbc-ea884ae318eb tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:21.441700 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-83ddc8a7-034b-4597-9bbc-ea884ae318eb tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:21.584459 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-83ddc8a7-034b-4597-9bbc-ea884ae318eb tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:21.592927 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-83ddc8a7-034b-4597-9bbc-ea884ae318eb tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:21.594476 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-83ddc8a7-034b-4597-9bbc-ea884ae318eb tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:21.595571 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-83ddc8a7-034b-4597-9bbc-ea884ae318eb tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1407 microversion: 2.20 time: 0.166697 Jun 30 18:29:21.596124 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 86/179] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:29:21 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:29:22.444492 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-de2594fa-f9e6-4741-aec9-8fff6f46ec63 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:22.445129 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-de2594fa-f9e6-4741-aec9-8fff6f46ec63 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:22.449813 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-f84edd08-670c-4732-8805-8605b8618f7a tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:22.450413 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-f84edd08-670c-4732-8805-8605b8618f7a tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:22.454739 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-de2594fa-f9e6-4741-aec9-8fff6f46ec63 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:22.459080 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-de2594fa-f9e6-4741-aec9-8fff6f46ec63 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:22.459324 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f84edd08-670c-4732-8805-8605b8618f7a tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:22.459766 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f84edd08-670c-4732-8805-8605b8618f7a tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:22.460376 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-de2594fa-f9e6-4741-aec9-8fff6f46ec63 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:22.460575 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f84edd08-670c-4732-8805-8605b8618f7a tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:22.461157 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f84edd08-670c-4732-8805-8605b8618f7a tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:22.461260 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-de2594fa-f9e6-4741-aec9-8fff6f46ec63 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:22.750177 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-f84edd08-670c-4732-8805-8605b8618f7a tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9762ad11e24246aefe2905eafe83f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96b506102ab4528956023c5e0f3dbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:22.757486 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-de2594fa-f9e6-4741-aec9-8fff6f46ec63 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:22.760931 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-f84edd08-670c-4732-8805-8605b8618f7a tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 200 len: 1314 microversion: 2.1 time: 0.315384 Jun 30 18:29:22.770388 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-de2594fa-f9e6-4741-aec9-8fff6f46ec63 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1321 microversion: 2.1 time: 0.328231 Jun 30 18:29:22.771225 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 94/180] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:22 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1321 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:22.784097 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 87/181] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:22 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:22.785561 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-be303e83-413b-4e1a-8280-66bb1642824c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:22.786749 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-be303e83-413b-4e1a-8280-66bb1642824c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:22.794664 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-be303e83-413b-4e1a-8280-66bb1642824c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:22.795561 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-be303e83-413b-4e1a-8280-66bb1642824c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:22.796340 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-be303e83-413b-4e1a-8280-66bb1642824c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:22.796930 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-be303e83-413b-4e1a-8280-66bb1642824c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:22.941030 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-14c2db41-68be-4988-b2fb-622a33d129b4 req-2aba3628-115d-4f9b-a77d-6c71f08b33ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "799aa3ef-4fdf-40c0-b76b-52ce98a386e8", "name": "network-vif-plugged", "status": "completed", "tag": "4db9cacb-c564-4286-bb44-3f838bceba71"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:29:22.950684 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-14c2db41-68be-4988-b2fb-622a33d129b4 req-2aba3628-115d-4f9b-a77d-6c71f08b33ec service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:22.952037 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-14c2db41-68be-4988-b2fb-622a33d129b4 req-2aba3628-115d-4f9b-a77d-6c71f08b33ec service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:22.967612 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.compute.server_external_events [req-14c2db41-68be-4988-b2fb-622a33d129b4 req-2aba3628-115d-4f9b-a77d-6c71f08b33ec service nova] Creating event network-vif-plugged:4db9cacb-c564-4286-bb44-3f838bceba71 for instance 799aa3ef-4fdf-40c0-b76b-52ce98a386e8 on hv-cinder-80378 Jun 30 18:29:22.973904 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-14c2db41-68be-4988-b2fb-622a33d129b4 req-2aba3628-115d-4f9b-a77d-6c71f08b33ec service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188267 Jun 30 18:29:22.975055 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 88/182] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:29:22.999088 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-be303e83-413b-4e1a-8280-66bb1642824c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:23.028957 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-be303e83-413b-4e1a-8280-66bb1642824c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:23.032494 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-be303e83-413b-4e1a-8280-66bb1642824c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:23.033657 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-be303e83-413b-4e1a-8280-66bb1642824c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1407 microversion: 2.20 time: 0.260667 Jun 30 18:29:23.034237 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 95/183] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:29:22 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1407 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:29:23.786233 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-3c749733-0400-4378-832d-135cc0d0618b tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:23.787948 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-5e97362a-47b5-42dc-a931-096a2090f303 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:23.788561 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-3c749733-0400-4378-832d-135cc0d0618b tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:23.788671 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-5e97362a-47b5-42dc-a931-096a2090f303 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:23.796845 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5e97362a-47b5-42dc-a931-096a2090f303 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:23.797462 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5e97362a-47b5-42dc-a931-096a2090f303 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:23.798712 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3c749733-0400-4378-832d-135cc0d0618b tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:23.798833 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5e97362a-47b5-42dc-a931-096a2090f303 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:23.799155 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5e97362a-47b5-42dc-a931-096a2090f303 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:23.799988 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3c749733-0400-4378-832d-135cc0d0618b tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:23.801368 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3c749733-0400-4378-832d-135cc0d0618b tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:23.802471 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3c749733-0400-4378-832d-135cc0d0618b tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:24.121265 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-3c749733-0400-4378-832d-135cc0d0618b tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9762ad11e24246aefe2905eafe83f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96b506102ab4528956023c5e0f3dbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:24.133654 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-3c749733-0400-4378-832d-135cc0d0618b tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 200 len: 1314 microversion: 2.1 time: 0.358966 Jun 30 18:29:24.134595 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 89/184] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:23 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:24.143737 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-5e97362a-47b5-42dc-a931-096a2090f303 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:24.150347 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-5e97362a-47b5-42dc-a931-096a2090f303 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1321 microversion: 2.1 time: 0.366637 Jun 30 18:29:24.151217 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 96/185] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:23 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1321 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:24.151808 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-5420322f-e366-4402-a2a6-d0540102fc58 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:24.152600 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-5420322f-e366-4402-a2a6-d0540102fc58 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:24.161511 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-5420322f-e366-4402-a2a6-d0540102fc58 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:24.162267 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-5420322f-e366-4402-a2a6-d0540102fc58 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:24.163139 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-5420322f-e366-4402-a2a6-d0540102fc58 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:24.163576 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-5420322f-e366-4402-a2a6-d0540102fc58 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:24.467585 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-5420322f-e366-4402-a2a6-d0540102fc58 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:24.479964 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-5420322f-e366-4402-a2a6-d0540102fc58 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:24.481465 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-5420322f-e366-4402-a2a6-d0540102fc58 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:24.483118 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-5420322f-e366-4402-a2a6-d0540102fc58 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1407 microversion: 2.20 time: 0.337703 Jun 30 18:29:24.483670 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 90/186] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:29:24 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1407 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:29:25.151653 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-9e327c89-c9e8-41a4-9664-b2baedd67b3a tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:25.152549 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-9e327c89-c9e8-41a4-9664-b2baedd67b3a tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:25.159004 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9e327c89-c9e8-41a4-9664-b2baedd67b3a tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:25.159641 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9e327c89-c9e8-41a4-9664-b2baedd67b3a tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:25.160561 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9e327c89-c9e8-41a4-9664-b2baedd67b3a tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:25.160982 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9e327c89-c9e8-41a4-9664-b2baedd67b3a tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:25.170915 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-e74ec167-2ae4-4ecf-bc1a-9295de7959dd tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:25.171598 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-e74ec167-2ae4-4ecf-bc1a-9295de7959dd tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:25.184410 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e74ec167-2ae4-4ecf-bc1a-9295de7959dd tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:25.185123 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e74ec167-2ae4-4ecf-bc1a-9295de7959dd tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:25.186632 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e74ec167-2ae4-4ecf-bc1a-9295de7959dd tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:25.187279 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e74ec167-2ae4-4ecf-bc1a-9295de7959dd tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:25.464170 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-9e327c89-c9e8-41a4-9664-b2baedd67b3a tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9762ad11e24246aefe2905eafe83f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96b506102ab4528956023c5e0f3dbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:25.469785 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-e74ec167-2ae4-4ecf-bc1a-9295de7959dd tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:25.476100 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-9e327c89-c9e8-41a4-9664-b2baedd67b3a tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 200 len: 1314 microversion: 2.1 time: 0.328580 Jun 30 18:29:25.477303 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 97/187] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:25 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:25.478236 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-e74ec167-2ae4-4ecf-bc1a-9295de7959dd tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1321 microversion: 2.1 time: 0.311158 Jun 30 18:29:25.478817 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 91/188] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:25 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1321 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:29:25.527046 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-36ba9b64-b447-4169-8c18-2a0efea136db tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:25.531267 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-36ba9b64-b447-4169-8c18-2a0efea136db tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:25.541272 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-36ba9b64-b447-4169-8c18-2a0efea136db tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:25.542302 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-36ba9b64-b447-4169-8c18-2a0efea136db tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:25.543158 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-36ba9b64-b447-4169-8c18-2a0efea136db tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:25.544094 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-36ba9b64-b447-4169-8c18-2a0efea136db tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:25.763186 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-36ba9b64-b447-4169-8c18-2a0efea136db tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:25.773557 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-36ba9b64-b447-4169-8c18-2a0efea136db tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:25.775795 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-36ba9b64-b447-4169-8c18-2a0efea136db tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:25.777039 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-36ba9b64-b447-4169-8c18-2a0efea136db tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1407 microversion: 2.20 time: 0.271319 Jun 30 18:29:25.777854 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 98/189] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:29:25 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1407 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:29:26.496679 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-7532699e-bcf3-4129-a16a-cdee7e76f8cf tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:26.497724 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-7532699e-bcf3-4129-a16a-cdee7e76f8cf tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:26.500002 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-96b693fa-12f8-4695-803f-81ff26cbfd35 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:26.501492 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-96b693fa-12f8-4695-803f-81ff26cbfd35 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:26.510608 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-96b693fa-12f8-4695-803f-81ff26cbfd35 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:26.511331 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-96b693fa-12f8-4695-803f-81ff26cbfd35 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:26.512365 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-96b693fa-12f8-4695-803f-81ff26cbfd35 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:26.513023 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-96b693fa-12f8-4695-803f-81ff26cbfd35 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:26.513482 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7532699e-bcf3-4129-a16a-cdee7e76f8cf tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:26.515863 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7532699e-bcf3-4129-a16a-cdee7e76f8cf tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:26.518136 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7532699e-bcf3-4129-a16a-cdee7e76f8cf tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:26.519186 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell1:SELECT=100 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:29:26.519675 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7532699e-bcf3-4129-a16a-cdee7e76f8cf tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:26.828673 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-96b693fa-12f8-4695-803f-81ff26cbfd35 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:26.838979 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-96b693fa-12f8-4695-803f-81ff26cbfd35 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1321 microversion: 2.1 time: 0.346627 Jun 30 18:29:26.839897 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 99/190] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:26 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1321 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:26.845652 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-e53ae43e-c664-4ae6-aea0-840ff24bf634 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:26.846645 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-e53ae43e-c664-4ae6-aea0-840ff24bf634 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:26.854841 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e53ae43e-c664-4ae6-aea0-840ff24bf634 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:26.855575 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e53ae43e-c664-4ae6-aea0-840ff24bf634 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:26.857251 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e53ae43e-c664-4ae6-aea0-840ff24bf634 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:26.858523 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e53ae43e-c664-4ae6-aea0-840ff24bf634 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:26.873456 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-7532699e-bcf3-4129-a16a-cdee7e76f8cf tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9762ad11e24246aefe2905eafe83f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96b506102ab4528956023c5e0f3dbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:26.883958 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-7532699e-bcf3-4129-a16a-cdee7e76f8cf tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 200 len: 1314 microversion: 2.1 time: 0.391969 Jun 30 18:29:26.884710 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 92/191] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:26 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 1314 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:27.038765 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-e53ae43e-c664-4ae6-aea0-840ff24bf634 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:27.075914 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-e53ae43e-c664-4ae6-aea0-840ff24bf634 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:27.082200 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-e53ae43e-c664-4ae6-aea0-840ff24bf634 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:27.083590 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-e53ae43e-c664-4ae6-aea0-840ff24bf634 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1407 microversion: 2.20 time: 0.242574 Jun 30 18:29:27.097696 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 100/192] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:29:26 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1407 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:29:27.858938 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-2493f8c1-478b-46e1-8e8b-7b73c4ee41fb tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:27.861329 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-2493f8c1-478b-46e1-8e8b-7b73c4ee41fb tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:27.871771 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2493f8c1-478b-46e1-8e8b-7b73c4ee41fb tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:27.872294 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2493f8c1-478b-46e1-8e8b-7b73c4ee41fb tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:27.874220 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2493f8c1-478b-46e1-8e8b-7b73c4ee41fb tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:27.874934 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2493f8c1-478b-46e1-8e8b-7b73c4ee41fb tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:27.902004 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-d2db6c8a-89fd-4ea0-80ad-015319ec136c tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:27.903592 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-d2db6c8a-89fd-4ea0-80ad-015319ec136c tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:27.912622 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d2db6c8a-89fd-4ea0-80ad-015319ec136c tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:27.913453 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell1:SELECT=100 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:29:27.913748 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d2db6c8a-89fd-4ea0-80ad-015319ec136c tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:27.914661 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d2db6c8a-89fd-4ea0-80ad-015319ec136c tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:27.915386 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d2db6c8a-89fd-4ea0-80ad-015319ec136c tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:28.133169 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-2493f8c1-478b-46e1-8e8b-7b73c4ee41fb tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:28.141427 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-2493f8c1-478b-46e1-8e8b-7b73c4ee41fb tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1321 microversion: 2.1 time: 0.288615 Jun 30 18:29:28.142031 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 93/193] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:27 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1321 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:28.147197 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-893b7b30-fca4-4f80-af90-5ed8cb6e6828 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:28.148083 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-893b7b30-fca4-4f80-af90-5ed8cb6e6828 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:28.154968 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-893b7b30-fca4-4f80-af90-5ed8cb6e6828 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:28.158585 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-d2db6c8a-89fd-4ea0-80ad-015319ec136c tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9762ad11e24246aefe2905eafe83f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96b506102ab4528956023c5e0f3dbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:28.158868 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-893b7b30-fca4-4f80-af90-5ed8cb6e6828 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:28.159860 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-893b7b30-fca4-4f80-af90-5ed8cb6e6828 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:28.160719 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-893b7b30-fca4-4f80-af90-5ed8cb6e6828 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:28.166875 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-d2db6c8a-89fd-4ea0-80ad-015319ec136c tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 200 len: 1314 microversion: 2.1 time: 0.269301 Jun 30 18:29:28.167612 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 101/194] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:27 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:29:28.329065 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-893b7b30-fca4-4f80-af90-5ed8cb6e6828 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:28.346389 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-893b7b30-fca4-4f80-af90-5ed8cb6e6828 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:28.348450 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-893b7b30-fca4-4f80-af90-5ed8cb6e6828 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:28.349942 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-893b7b30-fca4-4f80-af90-5ed8cb6e6828 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1407 microversion: 2.20 time: 0.206958 Jun 30 18:29:28.351065 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 94/195] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:29:28 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:29:28.950702 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [req-a1c95e6b-17eb-49c5-9d47-c7595c8efeed req-7f125ef4-2e1f-45b4-a792-972c14c7e20a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6c61f3b-a138-4d3c-971d-8f25d3124178", "name": "network-vif-plugged", "status": "completed", "tag": "8c7fc4bb-044c-4951-ae37-7f1aab689075"}]} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:29:28.968033 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-a1c95e6b-17eb-49c5-9d47-c7595c8efeed req-7f125ef4-2e1f-45b4-a792-972c14c7e20a service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:28.968945 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-a1c95e6b-17eb-49c5-9d47-c7595c8efeed req-7f125ef4-2e1f-45b4-a792-972c14c7e20a service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:28.986204 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.compute.server_external_events [req-a1c95e6b-17eb-49c5-9d47-c7595c8efeed req-7f125ef4-2e1f-45b4-a792-972c14c7e20a service nova] Creating event network-vif-plugged:8c7fc4bb-044c-4951-ae37-7f1aab689075 for instance d6c61f3b-a138-4d3c-971d-8f25d3124178 on hv-cinder-80378 Jun 30 18:29:28.992649 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [req-a1c95e6b-17eb-49c5-9d47-c7595c8efeed req-7f125ef4-2e1f-45b4-a792-972c14c7e20a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049519 Jun 30 18:29:28.993480 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 102/196] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:29:29.168492 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-fd764f67-3ae3-4fe0-a57d-2b63df756bc5 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:29.169085 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-fd764f67-3ae3-4fe0-a57d-2b63df756bc5 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:29.180105 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fd764f67-3ae3-4fe0-a57d-2b63df756bc5 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:29.180925 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fd764f67-3ae3-4fe0-a57d-2b63df756bc5 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:29.183251 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fd764f67-3ae3-4fe0-a57d-2b63df756bc5 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:29.183863 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fd764f67-3ae3-4fe0-a57d-2b63df756bc5 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:29.185087 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-5cdfc195-0895-4940-8d63-677e8bdda4e3 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:29.187238 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-5cdfc195-0895-4940-8d63-677e8bdda4e3 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:29.196647 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5cdfc195-0895-4940-8d63-677e8bdda4e3 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:29.198623 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5cdfc195-0895-4940-8d63-677e8bdda4e3 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:29.199402 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5cdfc195-0895-4940-8d63-677e8bdda4e3 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:29.200269 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5cdfc195-0895-4940-8d63-677e8bdda4e3 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:29.714648 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-5cdfc195-0895-4940-8d63-677e8bdda4e3 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9762ad11e24246aefe2905eafe83f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96b506102ab4528956023c5e0f3dbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:29.723925 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-5cdfc195-0895-4940-8d63-677e8bdda4e3 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 200 len: 1314 microversion: 2.1 time: 0.543327 Jun 30 18:29:29.724523 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 103/197] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:29 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 1314 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:29:29.747028 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-008b3e17-d050-4ccf-a0d9-1772b56ed6fa tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:29.752692 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-008b3e17-d050-4ccf-a0d9-1772b56ed6fa tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:29.767426 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-008b3e17-d050-4ccf-a0d9-1772b56ed6fa tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:29.768235 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-008b3e17-d050-4ccf-a0d9-1772b56ed6fa tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:29.769169 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-008b3e17-d050-4ccf-a0d9-1772b56ed6fa tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:29.771871 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-008b3e17-d050-4ccf-a0d9-1772b56ed6fa tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:29.792242 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-fd764f67-3ae3-4fe0-a57d-2b63df756bc5 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:29.803940 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-fd764f67-3ae3-4fe0-a57d-2b63df756bc5 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1321 microversion: 2.1 time: 0.639400 Jun 30 18:29:29.815355 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 95/198] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:29 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1321 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:30.011565 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-008b3e17-d050-4ccf-a0d9-1772b56ed6fa tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:30.025220 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-008b3e17-d050-4ccf-a0d9-1772b56ed6fa tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:30.027305 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-008b3e17-d050-4ccf-a0d9-1772b56ed6fa tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:30.028806 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-008b3e17-d050-4ccf-a0d9-1772b56ed6fa tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1407 microversion: 2.20 time: 0.287052 Jun 30 18:29:30.030589 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 104/199] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:29:29 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1407 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:29:30.746663 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-dd125928-9e02-4986-acf0-d59e34701082 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:30.747286 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-dd125928-9e02-4986-acf0-d59e34701082 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:30.760259 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-dd125928-9e02-4986-acf0-d59e34701082 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:30.760944 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-dd125928-9e02-4986-acf0-d59e34701082 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:30.762206 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-dd125928-9e02-4986-acf0-d59e34701082 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:30.762917 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-dd125928-9e02-4986-acf0-d59e34701082 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:30.826294 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-0eb8c0c4-5fab-4537-91b1-8b709dfd849a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:30.827031 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-0eb8c0c4-5fab-4537-91b1-8b709dfd849a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:30.837262 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0eb8c0c4-5fab-4537-91b1-8b709dfd849a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:30.838899 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0eb8c0c4-5fab-4537-91b1-8b709dfd849a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:30.842182 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0eb8c0c4-5fab-4537-91b1-8b709dfd849a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:30.842771 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0eb8c0c4-5fab-4537-91b1-8b709dfd849a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:31.147736 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-dd125928-9e02-4986-acf0-d59e34701082 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9762ad11e24246aefe2905eafe83f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96b506102ab4528956023c5e0f3dbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:31.151118 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-0eb8c0c4-5fab-4537-91b1-8b709dfd849a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:31.166913 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-dd125928-9e02-4986-acf0-d59e34701082 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 200 len: 1314 microversion: 2.1 time: 0.428977 Jun 30 18:29:31.168094 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-0eb8c0c4-5fab-4537-91b1-8b709dfd849a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1321 microversion: 2.1 time: 0.345570 Jun 30 18:29:31.180442 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 96/200] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:30 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 1314 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:31.191243 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 105/201] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:30 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1321 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:31.198934 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-0c141102-04f8-495a-b072-93e3f9ab50be tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:31.199541 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-0c141102-04f8-495a-b072-93e3f9ab50be tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:31.204052 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [req-a43efe1d-4adc-47cd-a0b2-92b50e4949e9 req-77d641fe-9945-4873-87bc-405764bd172b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5df6e0a7-4daa-4bb9-943a-69462fa6bcfd", "name": "network-vif-plugged", "status": "completed", "tag": "31020119-788a-4b78-a365-ced788236b04"}]} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:29:31.215301 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0c141102-04f8-495a-b072-93e3f9ab50be tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:31.216644 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0c141102-04f8-495a-b072-93e3f9ab50be tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:31.218032 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0c141102-04f8-495a-b072-93e3f9ab50be tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:31.218672 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0c141102-04f8-495a-b072-93e3f9ab50be tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:31.220585 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-a43efe1d-4adc-47cd-a0b2-92b50e4949e9 req-77d641fe-9945-4873-87bc-405764bd172b service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:31.220986 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-a43efe1d-4adc-47cd-a0b2-92b50e4949e9 req-77d641fe-9945-4873-87bc-405764bd172b service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:31.236172 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.compute.server_external_events [req-a43efe1d-4adc-47cd-a0b2-92b50e4949e9 req-77d641fe-9945-4873-87bc-405764bd172b service nova] Creating event network-vif-plugged:31020119-788a-4b78-a365-ced788236b04 for instance 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd on hv-cinder-80378 Jun 30 18:29:31.245331 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [req-a43efe1d-4adc-47cd-a0b2-92b50e4949e9 req-77d641fe-9945-4873-87bc-405764bd172b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052162 Jun 30 18:29:31.246593 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 106/202] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:29:31.374433 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-0c141102-04f8-495a-b072-93e3f9ab50be tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:31.384559 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-0c141102-04f8-495a-b072-93e3f9ab50be tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:31.386175 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-0c141102-04f8-495a-b072-93e3f9ab50be tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:31.390649 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-0c141102-04f8-495a-b072-93e3f9ab50be tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1407 microversion: 2.20 time: 0.192203 Jun 30 18:29:31.390649 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 97/203] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:29:31 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:29:32.199969 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-cf5a63e6-1f59-4154-b48d-9e184ccdf13b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:32.202129 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-cf5a63e6-1f59-4154-b48d-9e184ccdf13b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:32.203676 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-c6de6d23-bb35-4d95-89db-614ff7e88711 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:32.204301 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-c6de6d23-bb35-4d95-89db-614ff7e88711 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:32.215955 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cf5a63e6-1f59-4154-b48d-9e184ccdf13b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:32.216400 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cf5a63e6-1f59-4154-b48d-9e184ccdf13b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:32.219157 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cf5a63e6-1f59-4154-b48d-9e184ccdf13b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:32.219593 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cf5a63e6-1f59-4154-b48d-9e184ccdf13b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:32.221145 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c6de6d23-bb35-4d95-89db-614ff7e88711 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:32.221809 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c6de6d23-bb35-4d95-89db-614ff7e88711 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:32.222512 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c6de6d23-bb35-4d95-89db-614ff7e88711 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:32.222983 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c6de6d23-bb35-4d95-89db-614ff7e88711 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:32.505186 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-cf5a63e6-1f59-4154-b48d-9e184ccdf13b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:32.523131 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-cf5a63e6-1f59-4154-b48d-9e184ccdf13b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1321 microversion: 2.1 time: 0.337566 Jun 30 18:29:32.526578 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 107/204] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:32 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1321 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:32.553063 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-a18d3058-02d3-4ead-b573-c6e42ae96bc8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:32.553258 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-a18d3058-02d3-4ead-b573-c6e42ae96bc8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:32.570159 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-c6de6d23-bb35-4d95-89db-614ff7e88711 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9762ad11e24246aefe2905eafe83f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96b506102ab4528956023c5e0f3dbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:32.575053 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a18d3058-02d3-4ead-b573-c6e42ae96bc8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:32.580529 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a18d3058-02d3-4ead-b573-c6e42ae96bc8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:32.581891 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a18d3058-02d3-4ead-b573-c6e42ae96bc8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:32.582526 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a18d3058-02d3-4ead-b573-c6e42ae96bc8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:32.597230 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-c6de6d23-bb35-4d95-89db-614ff7e88711 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 200 len: 1314 microversion: 2.1 time: 0.403222 Jun 30 18:29:32.600261 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 98/205] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:32 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 1314 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:32.832707 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-a18d3058-02d3-4ead-b573-c6e42ae96bc8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:32.846663 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-a18d3058-02d3-4ead-b573-c6e42ae96bc8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:32.850422 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-a18d3058-02d3-4ead-b573-c6e42ae96bc8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:32.852098 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-a18d3058-02d3-4ead-b573-c6e42ae96bc8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1407 microversion: 2.20 time: 0.323961 Jun 30 18:29:32.852841 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 108/206] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:29:32 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1407 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:29:33.263143 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-17ce37e7-0da0-458e-9c7b-1c4339a46e3e req-df88a6e7-9bdc-4cb8-b139-cc33c0b2a09d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85c4025a-1510-4b69-a54e-94c9864064b9", "name": "network-vif-plugged", "status": "completed", "tag": "82ef2cd7-f1a8-48a7-bd5b-c0babc56b244"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:29:33.272024 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-17ce37e7-0da0-458e-9c7b-1c4339a46e3e req-df88a6e7-9bdc-4cb8-b139-cc33c0b2a09d service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:33.272563 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-17ce37e7-0da0-458e-9c7b-1c4339a46e3e req-df88a6e7-9bdc-4cb8-b139-cc33c0b2a09d service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:33.288961 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.compute.server_external_events [req-17ce37e7-0da0-458e-9c7b-1c4339a46e3e req-df88a6e7-9bdc-4cb8-b139-cc33c0b2a09d service nova] Creating event network-vif-plugged:82ef2cd7-f1a8-48a7-bd5b-c0babc56b244 for instance 85c4025a-1510-4b69-a54e-94c9864064b9 on hv-cinder-80378 Jun 30 18:29:33.299043 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-17ce37e7-0da0-458e-9c7b-1c4339a46e3e req-df88a6e7-9bdc-4cb8-b139-cc33c0b2a09d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039331 Jun 30 18:29:33.299803 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 99/207] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:29:33.544028 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-4126aeb7-6087-4e5c-b55d-1faacb2dfdf6 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:33.547027 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-4126aeb7-6087-4e5c-b55d-1faacb2dfdf6 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:33.549281 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_api:SELECT=78 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:29:33.556349 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-4126aeb7-6087-4e5c-b55d-1faacb2dfdf6 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:33.556982 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-4126aeb7-6087-4e5c-b55d-1faacb2dfdf6 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:33.557963 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-4126aeb7-6087-4e5c-b55d-1faacb2dfdf6 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:33.558770 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-4126aeb7-6087-4e5c-b55d-1faacb2dfdf6 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:33.616515 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-0af5423f-1476-4e81-b03e-9121ffbef4d2 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:33.617194 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-0af5423f-1476-4e81-b03e-9121ffbef4d2 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:33.624132 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0af5423f-1476-4e81-b03e-9121ffbef4d2 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:33.624575 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0af5423f-1476-4e81-b03e-9121ffbef4d2 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:33.625342 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0af5423f-1476-4e81-b03e-9121ffbef4d2 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:33.625816 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0af5423f-1476-4e81-b03e-9121ffbef4d2 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:33.784695 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-4126aeb7-6087-4e5c-b55d-1faacb2dfdf6 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:33.801569 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-4126aeb7-6087-4e5c-b55d-1faacb2dfdf6 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1321 microversion: 2.1 time: 0.259071 Jun 30 18:29:33.827630 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 109/208] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:33 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1321 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:33.870293 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-44811d44-81ce-4276-aa4c-3b02287eab3b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:33.871132 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-44811d44-81ce-4276-aa4c-3b02287eab3b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:33.890339 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-44811d44-81ce-4276-aa4c-3b02287eab3b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:33.891671 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-44811d44-81ce-4276-aa4c-3b02287eab3b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:33.892596 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-44811d44-81ce-4276-aa4c-3b02287eab3b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:33.893203 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-44811d44-81ce-4276-aa4c-3b02287eab3b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:33.909112 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-0af5423f-1476-4e81-b03e-9121ffbef4d2 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9762ad11e24246aefe2905eafe83f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96b506102ab4528956023c5e0f3dbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:33.920381 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-0af5423f-1476-4e81-b03e-9121ffbef4d2 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 200 len: 1500 microversion: 2.1 time: 0.306829 Jun 30 18:29:33.922129 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 100/209] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:33 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 1500 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:29:34.098109 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-44811d44-81ce-4276-aa4c-3b02287eab3b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:34.109270 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-44811d44-81ce-4276-aa4c-3b02287eab3b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:34.110986 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-44811d44-81ce-4276-aa4c-3b02287eab3b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:34.112635 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-44811d44-81ce-4276-aa4c-3b02287eab3b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1407 microversion: 2.20 time: 0.246463 Jun 30 18:29:34.113439 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 110/210] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:29:33 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 18:29:34.818457 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-7d507008-817a-43c6-ad79-91e2f97e56b7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:34.819202 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-7d507008-817a-43c6-ad79-91e2f97e56b7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:34.825240 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7d507008-817a-43c6-ad79-91e2f97e56b7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:34.825837 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7d507008-817a-43c6-ad79-91e2f97e56b7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:34.827396 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7d507008-817a-43c6-ad79-91e2f97e56b7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:34.828034 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7d507008-817a-43c6-ad79-91e2f97e56b7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:35.009298 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-7d507008-817a-43c6-ad79-91e2f97e56b7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:35.018331 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-7d507008-817a-43c6-ad79-91e2f97e56b7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1321 microversion: 2.1 time: 0.203685 Jun 30 18:29:35.019088 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 101/211] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:34 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:35.132034 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-fe088136-41fd-4afe-b20d-ae3e721dc510 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:35.133266 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-fe088136-41fd-4afe-b20d-ae3e721dc510 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:35.140717 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fe088136-41fd-4afe-b20d-ae3e721dc510 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:35.141428 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fe088136-41fd-4afe-b20d-ae3e721dc510 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:35.143521 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fe088136-41fd-4afe-b20d-ae3e721dc510 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:35.144896 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fe088136-41fd-4afe-b20d-ae3e721dc510 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:35.358056 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-fe088136-41fd-4afe-b20d-ae3e721dc510 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:35.368742 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-fe088136-41fd-4afe-b20d-ae3e721dc510 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:35.371425 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-fe088136-41fd-4afe-b20d-ae3e721dc510 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:35.374244 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-fe088136-41fd-4afe-b20d-ae3e721dc510 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1407 microversion: 2.20 time: 0.245141 Jun 30 18:29:35.376052 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 111/212] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:29:35 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:29:36.036511 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-bdb100a6-1fad-457c-be5f-29a4cddcad7d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:36.036511 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-bdb100a6-1fad-457c-be5f-29a4cddcad7d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:36.042934 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-bdb100a6-1fad-457c-be5f-29a4cddcad7d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:36.043486 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-bdb100a6-1fad-457c-be5f-29a4cddcad7d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:36.044563 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-bdb100a6-1fad-457c-be5f-29a4cddcad7d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:36.045212 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-bdb100a6-1fad-457c-be5f-29a4cddcad7d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:36.223460 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-bdb100a6-1fad-457c-be5f-29a4cddcad7d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:36.231674 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-bdb100a6-1fad-457c-be5f-29a4cddcad7d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1515 microversion: 2.1 time: 0.199615 Jun 30 18:29:36.232762 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 102/213] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:36 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1515 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:36.250037 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-e5e44c1f-f436-4cda-a299-f2063a4f9b38 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:29:36.252508 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-e5e44c1f-f436-4cda-a299-f2063a4f9b38 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:36.259389 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e5e44c1f-f436-4cda-a299-f2063a4f9b38 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:36.259827 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e5e44c1f-f436-4cda-a299-f2063a4f9b38 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:36.260584 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e5e44c1f-f436-4cda-a299-f2063a4f9b38 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:36.261005 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e5e44c1f-f436-4cda-a299-f2063a4f9b38 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:36.345787 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.objects.instance [None req-e5e44c1f-f436-4cda-a299-f2063a4f9b38 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lazy-loading 'flavor' on Instance uuid 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd {{(pid=117940) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 18:29:36.392629 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-07ad2c46-bd84-4b17-813d-4ec954b83c47 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:36.393231 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-07ad2c46-bd84-4b17-813d-4ec954b83c47 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:36.401794 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-07ad2c46-bd84-4b17-813d-4ec954b83c47 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:36.416299 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-07ad2c46-bd84-4b17-813d-4ec954b83c47 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:36.421533 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-07ad2c46-bd84-4b17-813d-4ec954b83c47 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:36.425480 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-07ad2c46-bd84-4b17-813d-4ec954b83c47 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:36.484209 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-e5e44c1f-f436-4cda-a299-f2063a4f9b38 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "POST /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd/action" status: 200 len: 32 microversion: 2.1 time: 0.238560 Jun 30 18:29:36.484877 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 112/214] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 30 18:29:36 2022] POST /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd/action => generated 32 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 18:29:36.507556 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-0a49d104-857b-48d9-86a8-8d95a43eb1cc tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:36.508542 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-0a49d104-857b-48d9-86a8-8d95a43eb1cc tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:36.515964 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0a49d104-857b-48d9-86a8-8d95a43eb1cc tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:36.516683 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0a49d104-857b-48d9-86a8-8d95a43eb1cc tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:36.517459 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0a49d104-857b-48d9-86a8-8d95a43eb1cc tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:36.517931 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0a49d104-857b-48d9-86a8-8d95a43eb1cc tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:36.702760 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-07ad2c46-bd84-4b17-813d-4ec954b83c47 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:36.720295 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-07ad2c46-bd84-4b17-813d-4ec954b83c47 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:36.730077 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-07ad2c46-bd84-4b17-813d-4ec954b83c47 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:36.731589 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-07ad2c46-bd84-4b17-813d-4ec954b83c47 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1407 microversion: 2.20 time: 0.343208 Jun 30 18:29:36.732330 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 103/215] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:29:36 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1407 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 18:29:36.778110 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-0a49d104-857b-48d9-86a8-8d95a43eb1cc tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:36.791400 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-0a49d104-857b-48d9-86a8-8d95a43eb1cc tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1521 microversion: 2.1 time: 0.301063 Jun 30 18:29:36.797239 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 113/216] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:36 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:29:36.811828 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-78c7c69a-9ca1-417c-9450-f64bd980374f tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd389b67-17cc-4bcf-b3ba-1b84b08a5e86"}} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:29:36.813296 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-78c7c69a-9ca1-417c-9450-f64bd980374f tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:36.819908 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-78c7c69a-9ca1-417c-9450-f64bd980374f tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:36.820751 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-78c7c69a-9ca1-417c-9450-f64bd980374f tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:36.821101 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-78c7c69a-9ca1-417c-9450-f64bd980374f tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:36.821663 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-78c7c69a-9ca1-417c-9450-f64bd980374f tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:37.065058 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-82be3b84-07c2-4d0d-a099-57fc21c942e1 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-360709914", "imageRef": "636d6d52-5033-47e1-bf75-0b4fc50c0bb0", "flavorRef": "452", "networks": [{"uuid": "18db706b-0736-4d9b-9de7-81f0382d8993"}]}} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:29:37.138095 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.network.neutron [None req-82be3b84-07c2-4d0d-a099-57fc21c942e1 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] validate_networks() for [('18db706b-0736-4d9b-9de7-81f0382d8993', None, None, None, None, None)] {{(pid=117940) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 18:29:37.642986 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-78c7c69a-9ca1-417c-9450-f64bd980374f tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "POST /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.835091 Jun 30 18:29:37.645436 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 104/217] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 30 18:29:36 2022] POST /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8/os-volume_attachments => generated 194 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:29:37.751105 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-3d5c52c2-b226-44c6-9de1-2cca8486ead8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:37.751803 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-3d5c52c2-b226-44c6-9de1-2cca8486ead8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:37.769267 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3d5c52c2-b226-44c6-9de1-2cca8486ead8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:37.771536 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3d5c52c2-b226-44c6-9de1-2cca8486ead8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:37.772520 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3d5c52c2-b226-44c6-9de1-2cca8486ead8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:37.773315 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3d5c52c2-b226-44c6-9de1-2cca8486ead8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:38.038730 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-82be3b84-07c2-4d0d-a099-57fc21c942e1 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Flavor limits 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 18:29:38.039569 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-82be3b84-07c2-4d0d-a099-57fc21c942e1 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Image limits 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 18:29:38.040100 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-82be3b84-07c2-4d0d-a099-57fc21c942e1 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Flavor pref 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 18:29:38.040880 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-82be3b84-07c2-4d0d-a099-57fc21c942e1 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Image pref 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 18:29:38.042763 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-82be3b84-07c2-4d0d-a099-57fc21c942e1 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 18:29:38.047720 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-3d5c52c2-b226-44c6-9de1-2cca8486ead8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:38.057778 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-3d5c52c2-b226-44c6-9de1-2cca8486ead8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:38.059736 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-3d5c52c2-b226-44c6-9de1-2cca8486ead8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:38.062342 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-3d5c52c2-b226-44c6-9de1-2cca8486ead8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1598 microversion: 2.20 time: 0.316312 Jun 30 18:29:38.063975 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 105/218] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:29:37 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1598 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:29:38.065653 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-82be3b84-07c2-4d0d-a099-57fc21c942e1 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:38.066467 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-82be3b84-07c2-4d0d-a099-57fc21c942e1 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:38.067622 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-82be3b84-07c2-4d0d-a099-57fc21c942e1 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:38.068789 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-82be3b84-07c2-4d0d-a099-57fc21c942e1 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:38.085731 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-7d12329d-d8f5-40d3-af40-a7e1b1da896b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:38.086564 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-7d12329d-d8f5-40d3-af40-a7e1b1da896b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:38.103869 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7d12329d-d8f5-40d3-af40-a7e1b1da896b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:38.104511 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7d12329d-d8f5-40d3-af40-a7e1b1da896b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:38.105466 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7d12329d-d8f5-40d3-af40-a7e1b1da896b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:38.106841 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7d12329d-d8f5-40d3-af40-a7e1b1da896b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:38.136023 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.quota [None req-82be3b84-07c2-4d0d-a099-57fc21c942e1 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Getting quotas for project 175743f30d314455a3bead1c50750fbe. Resources: {'ram', 'instances', 'cores'} {{(pid=117940) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 18:29:38.145502 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.quota [None req-82be3b84-07c2-4d0d-a099-57fc21c942e1 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Getting quotas for user 4128f8b7190e455b8dc599a404e3608c and project 175743f30d314455a3bead1c50750fbe. Resources: {'ram', 'instances', 'cores'} {{(pid=117940) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 18:29:38.173484 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-82be3b84-07c2-4d0d-a099-57fc21c942e1 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Going to run 1 instances... {{(pid=117940) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 18:29:38.175898 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-82be3b84-07c2-4d0d-a099-57fc21c942e1 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: dac8aacd-66be-4695-a513-af3d837d9d47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='636d6d52-5033-47e1-bf75-0b4fc50c0bb0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117940) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 18:29:38.289159 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-82be3b84-07c2-4d0d-a099-57fc21c942e1 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.228714 Jun 30 18:29:38.292581 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 114/219] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 30 18:29:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1233 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 30 18:29:38.303841 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-9838b5d7-abc7-4430-81de-3fa5e32b88e0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:38.310310 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-9838b5d7-abc7-4430-81de-3fa5e32b88e0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:38.355674 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9838b5d7-abc7-4430-81de-3fa5e32b88e0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:38.356777 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9838b5d7-abc7-4430-81de-3fa5e32b88e0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:38.365198 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9838b5d7-abc7-4430-81de-3fa5e32b88e0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:38.369356 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9838b5d7-abc7-4430-81de-3fa5e32b88e0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:38.453355 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-7d12329d-d8f5-40d3-af40-a7e1b1da896b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:38.461244 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-7d12329d-d8f5-40d3-af40-a7e1b1da896b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1521 microversion: 2.1 time: 0.395947 Jun 30 18:29:38.466611 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 106/220] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:38 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1521 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:38.489292 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-3e455d81-2a00-4d69-9659-8f3fa1c852da tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:38.490835 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-3e455d81-2a00-4d69-9659-8f3fa1c852da tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: dac8aacd-66be-4695-a513-af3d837d9d47] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:38.678423 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-3e455d81-2a00-4d69-9659-8f3fa1c852da tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:38.693064 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-3e455d81-2a00-4d69-9659-8f3fa1c852da tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47" status: 200 len: 1218 microversion: 2.1 time: 0.224549 Jun 30 18:29:38.702488 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-9838b5d7-abc7-4430-81de-3fa5e32b88e0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.400101 Jun 30 18:29:38.702488 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 115/222] 10.222.0.33 () {60 vars in 1315 bytes} [Thu Jun 30 18:29:38 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9/os-interface => generated 284 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 18:29:38.702643 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 107/222] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:38 2022] GET /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47 => generated 1218 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:39.484817 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-aae2b7b5-cc75-4601-9ea8-3303485cb89f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:39.486184 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-aae2b7b5-cc75-4601-9ea8-3303485cb89f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:39.494870 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-aae2b7b5-cc75-4601-9ea8-3303485cb89f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:39.495664 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-aae2b7b5-cc75-4601-9ea8-3303485cb89f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:39.496786 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-aae2b7b5-cc75-4601-9ea8-3303485cb89f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:39.497730 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-aae2b7b5-cc75-4601-9ea8-3303485cb89f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:39.526485 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:29:39.700854 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-aae2b7b5-cc75-4601-9ea8-3303485cb89f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:39.711664 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-c5384663-c41f-44a2-8552-36b646ad9b1d tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:39.712606 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-c5384663-c41f-44a2-8552-36b646ad9b1d tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: dac8aacd-66be-4695-a513-af3d837d9d47] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:39.727117 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-aae2b7b5-cc75-4601-9ea8-3303485cb89f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1521 microversion: 2.1 time: 0.248708 Jun 30 18:29:39.727947 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 116/223] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:39 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:39.729236 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c5384663-c41f-44a2-8552-36b646ad9b1d tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:39.729959 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c5384663-c41f-44a2-8552-36b646ad9b1d tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:39.730952 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c5384663-c41f-44a2-8552-36b646ad9b1d tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:39.731594 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c5384663-c41f-44a2-8552-36b646ad9b1d tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:39.848483 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-c5384663-c41f-44a2-8552-36b646ad9b1d tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:39.859260 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-c5384663-c41f-44a2-8552-36b646ad9b1d tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47" status: 200 len: 1270 microversion: 2.1 time: 0.151764 Jun 30 18:29:39.862263 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 108/224] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:39 2022] GET /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47 => generated 1270 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:40.751319 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-118dcaa9-fb0d-43e8-bc15-dda0949e39da tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:40.753799 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-118dcaa9-fb0d-43e8-bc15-dda0949e39da tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:40.765668 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-118dcaa9-fb0d-43e8-bc15-dda0949e39da tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:40.766198 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-118dcaa9-fb0d-43e8-bc15-dda0949e39da tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:40.767385 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-118dcaa9-fb0d-43e8-bc15-dda0949e39da tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:40.768428 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-118dcaa9-fb0d-43e8-bc15-dda0949e39da tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:40.879061 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-903b77fe-5fe9-4e49-aa5d-23a7249d02cf tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:40.880399 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-903b77fe-5fe9-4e49-aa5d-23a7249d02cf tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: dac8aacd-66be-4695-a513-af3d837d9d47] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:40.890161 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-903b77fe-5fe9-4e49-aa5d-23a7249d02cf tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:40.893596 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-903b77fe-5fe9-4e49-aa5d-23a7249d02cf tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:40.894439 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-903b77fe-5fe9-4e49-aa5d-23a7249d02cf tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:40.894882 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-903b77fe-5fe9-4e49-aa5d-23a7249d02cf tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:41.065273 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-903b77fe-5fe9-4e49-aa5d-23a7249d02cf tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:41.078088 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-903b77fe-5fe9-4e49-aa5d-23a7249d02cf tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47" status: 200 len: 1276 microversion: 2.1 time: 0.202496 Jun 30 18:29:41.079032 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 109/225] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:40 2022] GET /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47 => generated 1276 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:41.087825 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-1d65d130-cdbf-461a-8889-4ba6f65d5241 req-239535b8-890b-4a5a-987e-1c0b9b877d0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85c4025a-1510-4b69-a54e-94c9864064b9", "tag": "82ef2cd7-f1a8-48a7-bd5b-c0babc56b244"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:29:41.112333 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-118dcaa9-fb0d-43e8-bc15-dda0949e39da tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:41.117750 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-1d65d130-cdbf-461a-8889-4ba6f65d5241 req-239535b8-890b-4a5a-987e-1c0b9b877d0e service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:41.125190 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-1d65d130-cdbf-461a-8889-4ba6f65d5241 req-239535b8-890b-4a5a-987e-1c0b9b877d0e service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:41.129878 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-118dcaa9-fb0d-43e8-bc15-dda0949e39da tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1521 microversion: 2.1 time: 0.387583 Jun 30 18:29:41.130949 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 117/226] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:40 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1521 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:41.175380 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.compute.server_external_events [req-1d65d130-cdbf-461a-8889-4ba6f65d5241 req-239535b8-890b-4a5a-987e-1c0b9b877d0e service nova] Creating event network-changed:82ef2cd7-f1a8-48a7-bd5b-c0babc56b244 for instance 85c4025a-1510-4b69-a54e-94c9864064b9 on hv-cinder-80378 Jun 30 18:29:41.180963 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-1d65d130-cdbf-461a-8889-4ba6f65d5241 req-239535b8-890b-4a5a-987e-1c0b9b877d0e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100773 Jun 30 18:29:41.182285 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 110/227] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:29:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:29:42.101468 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-0a78a6c0-3abf-4e14-bad0-677178832869 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:42.103098 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-0a78a6c0-3abf-4e14-bad0-677178832869 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: dac8aacd-66be-4695-a513-af3d837d9d47] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:42.115833 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0a78a6c0-3abf-4e14-bad0-677178832869 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:42.116524 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0a78a6c0-3abf-4e14-bad0-677178832869 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:42.117484 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0a78a6c0-3abf-4e14-bad0-677178832869 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:42.118592 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0a78a6c0-3abf-4e14-bad0-677178832869 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:42.157446 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-3f1448ad-17c9-48e3-87eb-f259541fc6e9 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:42.158823 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-3f1448ad-17c9-48e3-87eb-f259541fc6e9 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:42.180346 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3f1448ad-17c9-48e3-87eb-f259541fc6e9 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:42.181138 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3f1448ad-17c9-48e3-87eb-f259541fc6e9 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:42.184249 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3f1448ad-17c9-48e3-87eb-f259541fc6e9 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:42.185265 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3f1448ad-17c9-48e3-87eb-f259541fc6e9 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:42.198695 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:29:42.489618 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-0a78a6c0-3abf-4e14-bad0-677178832869 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:42.504048 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-0a78a6c0-3abf-4e14-bad0-677178832869 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47" status: 200 len: 1318 microversion: 2.1 time: 0.411491 Jun 30 18:29:42.504960 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 118/228] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:42 2022] GET /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47 => generated 1318 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:42.537228 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-3f1448ad-17c9-48e3-87eb-f259541fc6e9 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:42.566155 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-3f1448ad-17c9-48e3-87eb-f259541fc6e9 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1521 microversion: 2.1 time: 0.417591 Jun 30 18:29:42.567993 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 111/229] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:42 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1521 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:43.218859 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [req-541df664-ab07-4e9d-aeb2-2907bac7d9e3 req-0ff6d75b-6308-471d-91a9-a432b7808ec7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dac8aacd-66be-4695-a513-af3d837d9d47", "tag": "87a044f4-f2f0-463e-a8fe-5c096420eb0e"}]} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:29:43.227250 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-541df664-ab07-4e9d-aeb2-2907bac7d9e3 req-0ff6d75b-6308-471d-91a9-a432b7808ec7 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:43.227906 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-541df664-ab07-4e9d-aeb2-2907bac7d9e3 req-0ff6d75b-6308-471d-91a9-a432b7808ec7 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:43.240082 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.compute.server_external_events [req-541df664-ab07-4e9d-aeb2-2907bac7d9e3 req-0ff6d75b-6308-471d-91a9-a432b7808ec7 service nova] Creating event network-changed:87a044f4-f2f0-463e-a8fe-5c096420eb0e for instance dac8aacd-66be-4695-a513-af3d837d9d47 on hv-cinder-80378 Jun 30 18:29:43.245160 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [req-541df664-ab07-4e9d-aeb2-2907bac7d9e3 req-0ff6d75b-6308-471d-91a9-a432b7808ec7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030599 Jun 30 18:29:43.245847 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 119/230] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:29:43.520787 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-6b54dcc4-5955-4803-89ce-c90d79086436 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:43.521395 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-6b54dcc4-5955-4803-89ce-c90d79086436 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: dac8aacd-66be-4695-a513-af3d837d9d47] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:43.528623 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6b54dcc4-5955-4803-89ce-c90d79086436 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:43.529063 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6b54dcc4-5955-4803-89ce-c90d79086436 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:43.530290 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6b54dcc4-5955-4803-89ce-c90d79086436 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:43.530713 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6b54dcc4-5955-4803-89ce-c90d79086436 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:43.588501 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-d756bcce-6b53-4887-800b-cd4234e5abcd tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:43.588501 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-d756bcce-6b53-4887-800b-cd4234e5abcd tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:43.594263 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d756bcce-6b53-4887-800b-cd4234e5abcd tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:43.594707 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d756bcce-6b53-4887-800b-cd4234e5abcd tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:43.595669 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d756bcce-6b53-4887-800b-cd4234e5abcd tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:43.596097 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d756bcce-6b53-4887-800b-cd4234e5abcd tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:43.726064 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-6b54dcc4-5955-4803-89ce-c90d79086436 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:43.733446 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-6b54dcc4-5955-4803-89ce-c90d79086436 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47" status: 200 len: 1318 microversion: 2.1 time: 0.216332 Jun 30 18:29:43.734069 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 112/231] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:43 2022] GET /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:43.769471 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-d756bcce-6b53-4887-800b-cd4234e5abcd tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:43.776949 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-d756bcce-6b53-4887-800b-cd4234e5abcd tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1521 microversion: 2.1 time: 0.196419 Jun 30 18:29:43.777514 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 120/232] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:43 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:29:44.751182 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-78069e96-2474-4a34-83ef-fbafc7e9573a tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:44.751942 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-78069e96-2474-4a34-83ef-fbafc7e9573a tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: dac8aacd-66be-4695-a513-af3d837d9d47] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:44.758847 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-78069e96-2474-4a34-83ef-fbafc7e9573a tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:44.759513 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-78069e96-2474-4a34-83ef-fbafc7e9573a tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:44.760380 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-78069e96-2474-4a34-83ef-fbafc7e9573a tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:44.760899 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-78069e96-2474-4a34-83ef-fbafc7e9573a tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:44.794934 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-1a4e895b-024d-4c06-8d7f-6e17b103468e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:44.796114 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-1a4e895b-024d-4c06-8d7f-6e17b103468e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:44.802351 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-1a4e895b-024d-4c06-8d7f-6e17b103468e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:44.802803 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-1a4e895b-024d-4c06-8d7f-6e17b103468e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:44.803604 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-1a4e895b-024d-4c06-8d7f-6e17b103468e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:44.804069 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-1a4e895b-024d-4c06-8d7f-6e17b103468e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:44.939524 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-78069e96-2474-4a34-83ef-fbafc7e9573a tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:44.947121 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-78069e96-2474-4a34-83ef-fbafc7e9573a tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47" status: 200 len: 1318 microversion: 2.1 time: 0.201082 Jun 30 18:29:44.947699 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 113/233] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:44 2022] GET /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:44.975643 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-1a4e895b-024d-4c06-8d7f-6e17b103468e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:44.984310 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-1a4e895b-024d-4c06-8d7f-6e17b103468e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1521 microversion: 2.1 time: 0.193605 Jun 30 18:29:44.984882 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 121/234] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:44 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:29:45.965320 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-7456977d-df00-4d20-87eb-2d54a63467b3 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:45.966084 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-7456977d-df00-4d20-87eb-2d54a63467b3 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: dac8aacd-66be-4695-a513-af3d837d9d47] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:45.974001 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7456977d-df00-4d20-87eb-2d54a63467b3 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:45.974449 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7456977d-df00-4d20-87eb-2d54a63467b3 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:45.975406 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7456977d-df00-4d20-87eb-2d54a63467b3 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:45.975842 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7456977d-df00-4d20-87eb-2d54a63467b3 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:46.005852 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-f2232529-9869-4a5c-8038-e75a184a4b56 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:46.007762 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-f2232529-9869-4a5c-8038-e75a184a4b56 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:46.015125 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f2232529-9869-4a5c-8038-e75a184a4b56 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:46.015987 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f2232529-9869-4a5c-8038-e75a184a4b56 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:46.017054 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f2232529-9869-4a5c-8038-e75a184a4b56 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:46.033943 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f2232529-9869-4a5c-8038-e75a184a4b56 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:46.191333 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-7456977d-df00-4d20-87eb-2d54a63467b3 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:46.200707 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-7456977d-df00-4d20-87eb-2d54a63467b3 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47" status: 200 len: 1318 microversion: 2.1 time: 0.238976 Jun 30 18:29:46.202281 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 114/235] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:45 2022] GET /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:46.229854 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-f2232529-9869-4a5c-8038-e75a184a4b56 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:46.238086 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-f2232529-9869-4a5c-8038-e75a184a4b56 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1521 microversion: 2.1 time: 0.237719 Jun 30 18:29:46.240472 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 122/236] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:45 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:29:47.219177 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-79edf707-479a-4fb9-904b-b4ad53e02c07 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:47.219904 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-79edf707-479a-4fb9-904b-b4ad53e02c07 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: dac8aacd-66be-4695-a513-af3d837d9d47] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:47.227939 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-79edf707-479a-4fb9-904b-b4ad53e02c07 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:47.228922 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-79edf707-479a-4fb9-904b-b4ad53e02c07 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:47.230685 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-79edf707-479a-4fb9-904b-b4ad53e02c07 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:47.231631 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-79edf707-479a-4fb9-904b-b4ad53e02c07 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:47.255150 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-8205b28c-d68c-4408-aada-30074c7c7289 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:47.256520 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-8205b28c-d68c-4408-aada-30074c7c7289 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:47.267835 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8205b28c-d68c-4408-aada-30074c7c7289 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:47.268526 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8205b28c-d68c-4408-aada-30074c7c7289 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:47.269535 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8205b28c-d68c-4408-aada-30074c7c7289 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:47.270275 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8205b28c-d68c-4408-aada-30074c7c7289 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:47.492492 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-79edf707-479a-4fb9-904b-b4ad53e02c07 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:47.495582 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-8205b28c-d68c-4408-aada-30074c7c7289 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:47.504962 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-79edf707-479a-4fb9-904b-b4ad53e02c07 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47" status: 200 len: 1318 microversion: 2.1 time: 0.290310 Jun 30 18:29:47.505547 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 115/237] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:47 2022] GET /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47 => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:29:47.511019 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-8205b28c-d68c-4408-aada-30074c7c7289 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1521 microversion: 2.1 time: 0.253635 Jun 30 18:29:47.511838 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 123/238] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:47 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:29:48.531942 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-f9e73ac0-5f0d-48b1-804f-1efda6e1695d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:48.533013 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-c672f0aa-2ced-4187-bdd0-4e9a12e9d74e tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:48.533946 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-c672f0aa-2ced-4187-bdd0-4e9a12e9d74e tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: dac8aacd-66be-4695-a513-af3d837d9d47] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:48.534354 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-f9e73ac0-5f0d-48b1-804f-1efda6e1695d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:48.537844 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell0:SELECT=2 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:29:48.538892 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell0:SELECT=6 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:29:48.547802 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c672f0aa-2ced-4187-bdd0-4e9a12e9d74e tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:48.548357 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f9e73ac0-5f0d-48b1-804f-1efda6e1695d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:48.549633 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c672f0aa-2ced-4187-bdd0-4e9a12e9d74e tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:48.550659 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c672f0aa-2ced-4187-bdd0-4e9a12e9d74e tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:48.551659 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c672f0aa-2ced-4187-bdd0-4e9a12e9d74e tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:48.553973 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f9e73ac0-5f0d-48b1-804f-1efda6e1695d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:48.554955 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f9e73ac0-5f0d-48b1-804f-1efda6e1695d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:48.555413 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f9e73ac0-5f0d-48b1-804f-1efda6e1695d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:48.683950 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell0:SELECT=2 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:29:48.885034 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-f9e73ac0-5f0d-48b1-804f-1efda6e1695d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:48.894055 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-f9e73ac0-5f0d-48b1-804f-1efda6e1695d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1521 microversion: 2.1 time: 0.367665 Jun 30 18:29:48.897955 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-c672f0aa-2ced-4187-bdd0-4e9a12e9d74e tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:48.902975 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 124/239] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:48 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1521 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:48.908949 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-c672f0aa-2ced-4187-bdd0-4e9a12e9d74e tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47" status: 200 len: 1318 microversion: 2.1 time: 0.390462 Jun 30 18:29:48.909811 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 116/240] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:48 2022] GET /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47 => generated 1318 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:48.920908 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-7c8b3a88-5441-4ec3-93f5-966fedd6ec12 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:48.921648 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-7c8b3a88-5441-4ec3-93f5-966fedd6ec12 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:48.928082 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7c8b3a88-5441-4ec3-93f5-966fedd6ec12 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:48.928528 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7c8b3a88-5441-4ec3-93f5-966fedd6ec12 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:48.929295 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7c8b3a88-5441-4ec3-93f5-966fedd6ec12 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:48.929770 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7c8b3a88-5441-4ec3-93f5-966fedd6ec12 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:48.960067 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-7c8b3a88-5441-4ec3-93f5-966fedd6ec12 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Going to try to terminate instance {{(pid=117940) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 18:29:49.055224 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-7c8b3a88-5441-4ec3-93f5-966fedd6ec12 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "DELETE /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 204 len: 0 microversion: 2.1 time: 0.147401 Jun 30 18:29:49.055885 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 125/241] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 30 18:29:48 2022] DELETE /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 18:29:49.065426 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-9737e7f3-3777-4e2f-9a86-118fcd9214d4 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:49.066229 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-9737e7f3-3777-4e2f-9a86-118fcd9214d4 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:49.072911 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9737e7f3-3777-4e2f-9a86-118fcd9214d4 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:49.073444 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9737e7f3-3777-4e2f-9a86-118fcd9214d4 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:49.074308 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9737e7f3-3777-4e2f-9a86-118fcd9214d4 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:49.074810 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9737e7f3-3777-4e2f-9a86-118fcd9214d4 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:49.221214 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-9737e7f3-3777-4e2f-9a86-118fcd9214d4 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9762ad11e24246aefe2905eafe83f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96b506102ab4528956023c5e0f3dbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:49.230264 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-9737e7f3-3777-4e2f-9a86-118fcd9214d4 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 200 len: 1552 microversion: 2.1 time: 0.170046 Jun 30 18:29:49.234616 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 117/242] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:49 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 1552 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:49.922048 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-3680c401-9240-49e6-a80d-2ceeb8294e3d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:49.923254 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-3680c401-9240-49e6-a80d-2ceeb8294e3d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:49.926638 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-fd5e6266-6eae-4adf-bcb8-b88ad812c4d7 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:49.927270 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-fd5e6266-6eae-4adf-bcb8-b88ad812c4d7 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: dac8aacd-66be-4695-a513-af3d837d9d47] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:49.933612 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3680c401-9240-49e6-a80d-2ceeb8294e3d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:49.935100 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fd5e6266-6eae-4adf-bcb8-b88ad812c4d7 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:49.936115 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fd5e6266-6eae-4adf-bcb8-b88ad812c4d7 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:49.937227 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3680c401-9240-49e6-a80d-2ceeb8294e3d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:49.937663 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fd5e6266-6eae-4adf-bcb8-b88ad812c4d7 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:49.938219 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3680c401-9240-49e6-a80d-2ceeb8294e3d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:49.938422 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fd5e6266-6eae-4adf-bcb8-b88ad812c4d7 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:49.938944 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3680c401-9240-49e6-a80d-2ceeb8294e3d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:50.173622 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-3680c401-9240-49e6-a80d-2ceeb8294e3d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:50.174603 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-fd5e6266-6eae-4adf-bcb8-b88ad812c4d7 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:50.182276 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-3680c401-9240-49e6-a80d-2ceeb8294e3d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1521 microversion: 2.1 time: 0.266606 Jun 30 18:29:50.184514 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 126/243] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:49 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:50.186842 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-fd5e6266-6eae-4adf-bcb8-b88ad812c4d7 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47" status: 200 len: 1318 microversion: 2.1 time: 0.264291 Jun 30 18:29:50.187414 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 118/244] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:49 2022] GET /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47 => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:50.248990 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-081cc19e-7982-4916-a660-d729198959f9 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:50.249764 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-081cc19e-7982-4916-a660-d729198959f9 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:50.255765 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-081cc19e-7982-4916-a660-d729198959f9 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:50.256328 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-081cc19e-7982-4916-a660-d729198959f9 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:50.257180 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-081cc19e-7982-4916-a660-d729198959f9 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:50.257961 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-081cc19e-7982-4916-a660-d729198959f9 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:50.435062 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-081cc19e-7982-4916-a660-d729198959f9 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9762ad11e24246aefe2905eafe83f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96b506102ab4528956023c5e0f3dbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:50.453278 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-081cc19e-7982-4916-a660-d729198959f9 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 200 len: 1552 microversion: 2.1 time: 0.202658 Jun 30 18:29:50.453278 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 127/245] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:50 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 1552 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:50.829323 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-2e6911c2-175d-4ddb-a4fd-ad92acf24b41 req-309aa5a1-8420-4546-b4c4-ab1d5348a0a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dac8aacd-66be-4695-a513-af3d837d9d47", "name": "network-vif-plugged", "status": "completed", "tag": "87a044f4-f2f0-463e-a8fe-5c096420eb0e"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:29:50.838345 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-2e6911c2-175d-4ddb-a4fd-ad92acf24b41 req-309aa5a1-8420-4546-b4c4-ab1d5348a0a7 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:50.840240 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-2e6911c2-175d-4ddb-a4fd-ad92acf24b41 req-309aa5a1-8420-4546-b4c4-ab1d5348a0a7 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:50.852794 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.compute.server_external_events [req-2e6911c2-175d-4ddb-a4fd-ad92acf24b41 req-309aa5a1-8420-4546-b4c4-ab1d5348a0a7 service nova] Creating event network-vif-plugged:87a044f4-f2f0-463e-a8fe-5c096420eb0e for instance dac8aacd-66be-4695-a513-af3d837d9d47 on hv-cinder-80378 Jun 30 18:29:50.859488 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-2e6911c2-175d-4ddb-a4fd-ad92acf24b41 req-309aa5a1-8420-4546-b4c4-ab1d5348a0a7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034853 Jun 30 18:29:50.860561 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 119/246] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:29:51.203662 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-3871d278-d0c8-4c70-a50f-5cb42fed97aa tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:51.204569 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-957d6ef4-ed89-4306-bdf5-e6e6dbecb807 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:51.205124 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-3871d278-d0c8-4c70-a50f-5cb42fed97aa tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:51.205403 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-957d6ef4-ed89-4306-bdf5-e6e6dbecb807 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: dac8aacd-66be-4695-a513-af3d837d9d47] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:51.209081 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_api:SELECT=72 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:29:51.211478 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3871d278-d0c8-4c70-a50f-5cb42fed97aa tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:51.211917 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3871d278-d0c8-4c70-a50f-5cb42fed97aa tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:51.212776 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3871d278-d0c8-4c70-a50f-5cb42fed97aa tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:51.213261 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3871d278-d0c8-4c70-a50f-5cb42fed97aa tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:51.213721 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-957d6ef4-ed89-4306-bdf5-e6e6dbecb807 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:51.214238 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-957d6ef4-ed89-4306-bdf5-e6e6dbecb807 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:51.215090 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-957d6ef4-ed89-4306-bdf5-e6e6dbecb807 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:51.215644 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-957d6ef4-ed89-4306-bdf5-e6e6dbecb807 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:51.594559 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-957d6ef4-ed89-4306-bdf5-e6e6dbecb807 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:51.601955 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-957d6ef4-ed89-4306-bdf5-e6e6dbecb807 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47" status: 200 len: 1318 microversion: 2.1 time: 0.402103 Jun 30 18:29:51.602539 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 120/247] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:51 2022] GET /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47 => generated 1318 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:51.607074 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-a6a5b4b9-b3e7-45b3-9d83-273fe9dffd10 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:51.608795 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-a6a5b4b9-b3e7-45b3-9d83-273fe9dffd10 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:51.615626 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a6a5b4b9-b3e7-45b3-9d83-273fe9dffd10 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:51.616559 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a6a5b4b9-b3e7-45b3-9d83-273fe9dffd10 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:51.619869 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-3871d278-d0c8-4c70-a50f-5cb42fed97aa tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:51.630661 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a6a5b4b9-b3e7-45b3-9d83-273fe9dffd10 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:51.631196 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a6a5b4b9-b3e7-45b3-9d83-273fe9dffd10 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:51.638193 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-3871d278-d0c8-4c70-a50f-5cb42fed97aa tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1521 microversion: 2.1 time: 0.439669 Jun 30 18:29:51.645920 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 128/248] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:51 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1521 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:51.767781 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-a6a5b4b9-b3e7-45b3-9d83-273fe9dffd10 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9762ad11e24246aefe2905eafe83f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96b506102ab4528956023c5e0f3dbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:51.775712 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-a6a5b4b9-b3e7-45b3-9d83-273fe9dffd10 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 200 len: 1552 microversion: 2.1 time: 0.172085 Jun 30 18:29:51.776280 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 121/249] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:51 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 1552 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:52.619510 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-e56380e3-3c43-4327-8d43-04ff3c4aabdc tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:52.620145 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-e56380e3-3c43-4327-8d43-04ff3c4aabdc tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: dac8aacd-66be-4695-a513-af3d837d9d47] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:52.627003 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e56380e3-3c43-4327-8d43-04ff3c4aabdc tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:52.627499 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e56380e3-3c43-4327-8d43-04ff3c4aabdc tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:52.628321 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e56380e3-3c43-4327-8d43-04ff3c4aabdc tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:52.628774 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e56380e3-3c43-4327-8d43-04ff3c4aabdc tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:52.667773 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-7bfa828a-fddc-4ec8-832b-bab2249c1e3e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:52.668766 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-7bfa828a-fddc-4ec8-832b-bab2249c1e3e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:52.691277 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7bfa828a-fddc-4ec8-832b-bab2249c1e3e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:52.691829 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7bfa828a-fddc-4ec8-832b-bab2249c1e3e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:52.692925 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7bfa828a-fddc-4ec8-832b-bab2249c1e3e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:52.693483 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7bfa828a-fddc-4ec8-832b-bab2249c1e3e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:52.852118 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-e56380e3-3c43-4327-8d43-04ff3c4aabdc tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:52.859940 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-e56380e3-3c43-4327-8d43-04ff3c4aabdc tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47" status: 200 len: 1318 microversion: 2.1 time: 0.244292 Jun 30 18:29:52.860529 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 129/250] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:52 2022] GET /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47 => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:52.865171 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-71d02600-a43c-4ad0-b16f-9927514eeb50 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:52.874488 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-71d02600-a43c-4ad0-b16f-9927514eeb50 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:52.887420 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-71d02600-a43c-4ad0-b16f-9927514eeb50 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:52.890018 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-71d02600-a43c-4ad0-b16f-9927514eeb50 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:52.891537 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-71d02600-a43c-4ad0-b16f-9927514eeb50 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:52.892888 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-71d02600-a43c-4ad0-b16f-9927514eeb50 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:52.940359 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-7bfa828a-fddc-4ec8-832b-bab2249c1e3e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:52.964106 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-7bfa828a-fddc-4ec8-832b-bab2249c1e3e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1521 microversion: 2.1 time: 0.311582 Jun 30 18:29:52.975570 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 122/251] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:52 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1521 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:53.101044 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-71d02600-a43c-4ad0-b16f-9927514eeb50 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9762ad11e24246aefe2905eafe83f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96b506102ab4528956023c5e0f3dbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:53.110764 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-71d02600-a43c-4ad0-b16f-9927514eeb50 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 200 len: 1552 microversion: 2.1 time: 0.249200 Jun 30 18:29:53.111352 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 130/252] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:52 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 1552 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:53.758356 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-f1ef1bca-a8d3-4998-8e85-97537278e1ae req-2f6509bb-f9eb-42d2-980e-f4f19551ed2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "799aa3ef-4fdf-40c0-b76b-52ce98a386e8", "name": "network-vif-deleted", "tag": "4db9cacb-c564-4286-bb44-3f838bceba71"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:29:53.774861 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-f1ef1bca-a8d3-4998-8e85-97537278e1ae req-2f6509bb-f9eb-42d2-980e-f4f19551ed2a service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:53.775795 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-f1ef1bca-a8d3-4998-8e85-97537278e1ae req-2f6509bb-f9eb-42d2-980e-f4f19551ed2a service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:53.789451 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.compute.server_external_events [req-f1ef1bca-a8d3-4998-8e85-97537278e1ae req-2f6509bb-f9eb-42d2-980e-f4f19551ed2a service nova] Creating event network-vif-deleted:4db9cacb-c564-4286-bb44-3f838bceba71 for instance 799aa3ef-4fdf-40c0-b76b-52ce98a386e8 on hv-cinder-80378 Jun 30 18:29:53.794458 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-f1ef1bca-a8d3-4998-8e85-97537278e1ae req-2f6509bb-f9eb-42d2-980e-f4f19551ed2a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040607 Jun 30 18:29:53.795650 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 123/253] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:29:53.878083 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-d1016ac9-0a9e-4c0e-8bd1-c971b27bc145 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:53.879276 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-d1016ac9-0a9e-4c0e-8bd1-c971b27bc145 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: dac8aacd-66be-4695-a513-af3d837d9d47] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:53.885491 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d1016ac9-0a9e-4c0e-8bd1-c971b27bc145 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:53.886171 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d1016ac9-0a9e-4c0e-8bd1-c971b27bc145 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:53.887123 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d1016ac9-0a9e-4c0e-8bd1-c971b27bc145 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:53.887820 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d1016ac9-0a9e-4c0e-8bd1-c971b27bc145 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:53.988935 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-c2d5256a-add5-44a6-8a8a-3af6887f868c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:53.990313 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-c2d5256a-add5-44a6-8a8a-3af6887f868c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:53.997659 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c2d5256a-add5-44a6-8a8a-3af6887f868c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:53.998074 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c2d5256a-add5-44a6-8a8a-3af6887f868c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:53.999186 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c2d5256a-add5-44a6-8a8a-3af6887f868c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:53.999543 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c2d5256a-add5-44a6-8a8a-3af6887f868c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:54.160853 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-d1016ac9-0a9e-4c0e-8bd1-c971b27bc145 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:54.165867 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:29:54.172749 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-d1016ac9-0a9e-4c0e-8bd1-c971b27bc145 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47" status: 200 len: 1508 microversion: 2.1 time: 0.299170 Jun 30 18:29:54.173418 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 131/254] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:53 2022] GET /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47 => generated 1508 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:54.178809 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-3046b357-5696-4942-9102-9597f7dbedbe tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:54.179757 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-3046b357-5696-4942-9102-9597f7dbedbe tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:54.190529 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3046b357-5696-4942-9102-9597f7dbedbe tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:54.190529 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3046b357-5696-4942-9102-9597f7dbedbe tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:54.191387 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3046b357-5696-4942-9102-9597f7dbedbe tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:54.192029 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3046b357-5696-4942-9102-9597f7dbedbe tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:54.339926 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-3046b357-5696-4942-9102-9597f7dbedbe tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9762ad11e24246aefe2905eafe83f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96b506102ab4528956023c5e0f3dbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:54.341501 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-c2d5256a-add5-44a6-8a8a-3af6887f868c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:54.358853 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-c2d5256a-add5-44a6-8a8a-3af6887f868c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1521 microversion: 2.1 time: 0.378877 Jun 30 18:29:54.362059 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-3046b357-5696-4942-9102-9597f7dbedbe tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 200 len: 1345 microversion: 2.1 time: 0.183638 Jun 30 18:29:54.362830 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 132/255] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:54 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 1345 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:54.366732 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 124/256] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:53 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1521 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:55.379967 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-dddd3761-0279-4774-9f92-c173ddcdd3a7 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:55.381053 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-dddd3761-0279-4774-9f92-c173ddcdd3a7 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:55.383586 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-16bfee4a-f32a-4c6f-9dd5-ade7568439e3 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:55.384727 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-16bfee4a-f32a-4c6f-9dd5-ade7568439e3 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:55.388193 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-dddd3761-0279-4774-9f92-c173ddcdd3a7 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:55.388647 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-dddd3761-0279-4774-9f92-c173ddcdd3a7 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:55.390224 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-dddd3761-0279-4774-9f92-c173ddcdd3a7 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:55.393504 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-16bfee4a-f32a-4c6f-9dd5-ade7568439e3 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:55.394289 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-16bfee4a-f32a-4c6f-9dd5-ade7568439e3 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:55.395239 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-16bfee4a-f32a-4c6f-9dd5-ade7568439e3 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:55.395851 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-16bfee4a-f32a-4c6f-9dd5-ade7568439e3 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:55.398985 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-dddd3761-0279-4774-9f92-c173ddcdd3a7 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:55.420634 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.wsgi [None req-dddd3761-0279-4774-9f92-c173ddcdd3a7 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] HTTP exception thrown: Instance 799aa3ef-4fdf-40c0-b76b-52ce98a386e8 could not be found. Jun 30 18:29:55.438005 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-dddd3761-0279-4774-9f92-c173ddcdd3a7 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Request method failure captured: Jun 30 18:29:55.438005 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: request: GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 HTTP/1.1 Jun 30 18:29:55.438005 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept: application/json Jun 30 18:29:55.438005 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept-Encoding: identity Jun 30 18:29:55.438005 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Connection: close Jun 30 18:29:55.438005 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Length: 0 Jun 30 18:29:55.438005 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Type: application/json Jun 30 18:29:55.438005 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Host: 10.222.0.33 Jun 30 18:29:55.438005 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Openstack-System-Scope: None Jun 30 18:29:55.438005 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: User-Agent: python-urllib3/1.26.9 Jun 30 18:29:55.438005 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Auth-Token: gAAAAABivetSDIIqIsymnhD54LPtThV0zwF_CO3V_BqU3Cm3FvwZU_xXmGhfFDfXaFYAQ-z_yHgqSAVQBY8MiKVEpq_nIbPDN5LyoItcZOzYRXLHb89jO6vaUHRMPtzAwcCtbo4TxkLybjMEe69uWz73EpZunXiLaiGuy6yd65_ZV431ml5mKyo Jun 30 18:29:55.438005 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Id: None Jun 30 18:29:55.438005 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Name: None Jun 30 18:29:55.438005 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Identity-Status: Confirmed Jun 30 18:29:55.438005 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Is-Admin-Project: True Jun 30 18:29:55.438005 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Id: default Jun 30 18:29:55.438005 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Name: Default Jun 30 18:29:55.438005 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Id: e96b506102ab4528956023c5e0f3dbcf Jun 30 18:29:55.438005 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Name: tempest-DeleteServersTestJSON-751316779 Jun 30 18:29:55.438005 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Role: reader,member Jun 30 18:29:55.438005 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Roles: reader,member Jun 30 18:29:55.439859 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e96b506102ab4528956023c5e0f3dbcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e96b506102ab4528956023c5e0f3dbcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e96b506102ab4528956023c5e0f3dbcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e96b506102ab4528956023c5e0f3dbcf"}]}] Jun 30 18:29:55.439859 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant: tempest-DeleteServersTestJSON-751316779 Jun 30 18:29:55.439859 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Id: e96b506102ab4528956023c5e0f3dbcf Jun 30 18:29:55.439859 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Name: tempest-DeleteServersTestJSON-751316779 Jun 30 18:29:55.439859 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User: tempest-DeleteServersTestJSON-751316779-project Jun 30 18:29:55.439859 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Id: default Jun 30 18:29:55.439859 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Name: Default Jun 30 18:29:55.439859 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Id: db9762ad11e24246aefe2905eafe83f1 Jun 30 18:29:55.439859 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Name: tempest-DeleteServersTestJSON-751316779-project Jun 30 18:29:55.439859 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: method: > Jun 30 18:29:55.439859 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: exception: Instance 799aa3ef-4fdf-40c0-b76b-52ce98a386e8 could not be found. Jun 30 18:29:55.439859 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: action_args: {'id': '799aa3ef-4fdf-40c0-b76b-52ce98a386e8'} Jun 30 18:29:55.440704 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:29:55.440704 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:29:55.440704 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:29:55.440704 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:29:55.440704 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:29:55.440704 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:29:55.440704 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:29:55.440704 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:29:55.440704 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:29:55.440704 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:29:55.440704 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 799aa3ef-4fdf-40c0-b76b-52ce98a386e8 could not be found. Jun 30 18:29:55.440704 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:29:55.440704 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:29:55.440704 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:29:55.440704 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:29:55.440704 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:29:55.440704 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:29:55.440704 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:29:55.440704 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:29:55.440704 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:29:55.442152 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:29:55.442152 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:29:55.442152 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:29:55.442152 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:29:55.442152 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:29:55.442152 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:29:55.442152 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:29:55.442152 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 799aa3ef-4fdf-40c0-b76b-52ce98a386e8 could not be found. Jun 30 18:29:55.442152 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:29:55.442152 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:29:55.442152 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:29:55.442152 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:29:55.442152 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:29:55.442152 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:29:55.442152 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:29:55.442152 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:29:55.442152 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 799aa3ef-4fdf-40c0-b76b-52ce98a386e8 could not be found. Jun 30 18:29:55.442152 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:29:55.443480 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-dddd3761-0279-4774-9f92-c173ddcdd3a7 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Returning 404 to user: Instance 799aa3ef-4fdf-40c0-b76b-52ce98a386e8 could not be found. {{(pid=117940) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:29:55.443480 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-dddd3761-0279-4774-9f92-c173ddcdd3a7 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 404 len: 111 microversion: 2.1 time: 0.067433 Jun 30 18:29:55.444241 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 133/257] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:55 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:29:55.580679 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-16bfee4a-f32a-4c6f-9dd5-ade7568439e3 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:55.591614 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-16bfee4a-f32a-4c6f-9dd5-ade7568439e3 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1521 microversion: 2.1 time: 0.211771 Jun 30 18:29:55.593921 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 125/258] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:55 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:29:55.604074 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-37677050-0577-4c74-80f2-b34bb358b892 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:55.605079 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-37677050-0577-4c74-80f2-b34bb358b892 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:55.611750 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-37677050-0577-4c74-80f2-b34bb358b892 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:55.612206 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-37677050-0577-4c74-80f2-b34bb358b892 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:55.612956 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-37677050-0577-4c74-80f2-b34bb358b892 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:55.613557 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-37677050-0577-4c74-80f2-b34bb358b892 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:55.628634 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.wsgi [None req-37677050-0577-4c74-80f2-b34bb358b892 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] HTTP exception thrown: Instance 799aa3ef-4fdf-40c0-b76b-52ce98a386e8 could not be found. Jun 30 18:29:55.630287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-37677050-0577-4c74-80f2-b34bb358b892 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Request method failure captured: Jun 30 18:29:55.630287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: request: GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8/os-volume_attachments HTTP/1.1 Jun 30 18:29:55.630287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept: application/json Jun 30 18:29:55.630287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept-Encoding: identity Jun 30 18:29:55.630287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Connection: close Jun 30 18:29:55.630287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Length: 0 Jun 30 18:29:55.630287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Type: application/json Jun 30 18:29:55.630287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Host: 10.222.0.33 Jun 30 18:29:55.630287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Openstack-System-Scope: None Jun 30 18:29:55.630287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: User-Agent: python-urllib3/1.26.9 Jun 30 18:29:55.630287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Auth-Token: gAAAAABivetSDIIqIsymnhD54LPtThV0zwF_CO3V_BqU3Cm3FvwZU_xXmGhfFDfXaFYAQ-z_yHgqSAVQBY8MiKVEpq_nIbPDN5LyoItcZOzYRXLHb89jO6vaUHRMPtzAwcCtbo4TxkLybjMEe69uWz73EpZunXiLaiGuy6yd65_ZV431ml5mKyo Jun 30 18:29:55.630287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Id: None Jun 30 18:29:55.630287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Name: None Jun 30 18:29:55.630287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Identity-Status: Confirmed Jun 30 18:29:55.630287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Is-Admin-Project: True Jun 30 18:29:55.630287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Id: default Jun 30 18:29:55.630287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Name: Default Jun 30 18:29:55.630287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Id: e96b506102ab4528956023c5e0f3dbcf Jun 30 18:29:55.630287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Name: tempest-DeleteServersTestJSON-751316779 Jun 30 18:29:55.630287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Role: reader,member Jun 30 18:29:55.630287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Roles: reader,member Jun 30 18:29:55.631761 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e96b506102ab4528956023c5e0f3dbcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e96b506102ab4528956023c5e0f3dbcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e96b506102ab4528956023c5e0f3dbcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e96b506102ab4528956023c5e0f3dbcf"}]}] Jun 30 18:29:55.631761 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant: tempest-DeleteServersTestJSON-751316779 Jun 30 18:29:55.631761 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Id: e96b506102ab4528956023c5e0f3dbcf Jun 30 18:29:55.631761 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Name: tempest-DeleteServersTestJSON-751316779 Jun 30 18:29:55.631761 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User: tempest-DeleteServersTestJSON-751316779-project Jun 30 18:29:55.631761 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Id: default Jun 30 18:29:55.631761 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Name: Default Jun 30 18:29:55.631761 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Id: db9762ad11e24246aefe2905eafe83f1 Jun 30 18:29:55.631761 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Name: tempest-DeleteServersTestJSON-751316779-project Jun 30 18:29:55.631761 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: method: > Jun 30 18:29:55.631761 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: exception: Instance 799aa3ef-4fdf-40c0-b76b-52ce98a386e8 could not be found. Jun 30 18:29:55.631761 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: action_args: {'server_id': '799aa3ef-4fdf-40c0-b76b-52ce98a386e8'} Jun 30 18:29:55.632631 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:29:55.632631 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:29:55.632631 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:29:55.632631 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:29:55.632631 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:29:55.632631 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:29:55.632631 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:29:55.632631 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:29:55.632631 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:29:55.632631 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:29:55.632631 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 799aa3ef-4fdf-40c0-b76b-52ce98a386e8 could not be found. Jun 30 18:29:55.632631 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:29:55.632631 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:29:55.632631 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:29:55.632631 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:29:55.632631 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:29:55.632631 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:29:55.632631 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:29:55.632631 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:29:55.632631 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:29:55.633908 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:29:55.633908 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 30 18:29:55.633908 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 18:29:55.633908 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 30 18:29:55.633908 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 18:29:55.633908 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 30 18:29:55.633908 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 30 18:29:55.633908 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:29:55.633908 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:29:55.633908 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 799aa3ef-4fdf-40c0-b76b-52ce98a386e8 could not be found. Jun 30 18:29:55.633908 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:29:55.633908 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:29:55.633908 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:29:55.633908 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:29:55.633908 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:29:55.633908 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:29:55.633908 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:29:55.633908 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:29:55.633908 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 799aa3ef-4fdf-40c0-b76b-52ce98a386e8 could not be found. Jun 30 18:29:55.633908 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:29:55.635194 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-37677050-0577-4c74-80f2-b34bb358b892 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Returning 404 to user: Instance 799aa3ef-4fdf-40c0-b76b-52ce98a386e8 could not be found. {{(pid=117940) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:29:55.635194 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-37677050-0577-4c74-80f2-b34bb358b892 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031852 Jun 30 18:29:55.635194 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 134/259] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 30 18:29:55 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:29:56.610373 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-61147b5c-dc21-4f32-baa9-2fd48ebea40a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:56.611066 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-61147b5c-dc21-4f32-baa9-2fd48ebea40a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:56.618463 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-61147b5c-dc21-4f32-baa9-2fd48ebea40a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:56.618914 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-61147b5c-dc21-4f32-baa9-2fd48ebea40a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:56.620239 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-61147b5c-dc21-4f32-baa9-2fd48ebea40a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:56.620681 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-61147b5c-dc21-4f32-baa9-2fd48ebea40a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:56.787709 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-61147b5c-dc21-4f32-baa9-2fd48ebea40a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:56.797261 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-61147b5c-dc21-4f32-baa9-2fd48ebea40a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1521 microversion: 2.1 time: 0.191505 Jun 30 18:29:56.798336 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 126/260] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:56 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:56.890782 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-7701350c-9ec3-47d8-94d7-6f7813d1e393 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:56.891347 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-7701350c-9ec3-47d8-94d7-6f7813d1e393 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:56.909948 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7701350c-9ec3-47d8-94d7-6f7813d1e393 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:56.910393 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7701350c-9ec3-47d8-94d7-6f7813d1e393 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:56.911362 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7701350c-9ec3-47d8-94d7-6f7813d1e393 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:56.911794 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7701350c-9ec3-47d8-94d7-6f7813d1e393 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:56.928121 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.wsgi [None req-7701350c-9ec3-47d8-94d7-6f7813d1e393 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] HTTP exception thrown: Instance 799aa3ef-4fdf-40c0-b76b-52ce98a386e8 could not be found. Jun 30 18:29:56.929778 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-7701350c-9ec3-47d8-94d7-6f7813d1e393 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Request method failure captured: Jun 30 18:29:56.929778 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: request: DELETE /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 HTTP/1.1 Jun 30 18:29:56.929778 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept: application/json Jun 30 18:29:56.929778 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept-Encoding: identity Jun 30 18:29:56.929778 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Connection: close Jun 30 18:29:56.929778 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Length: 0 Jun 30 18:29:56.929778 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Type: application/json Jun 30 18:29:56.929778 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Host: 10.222.0.33 Jun 30 18:29:56.929778 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Openstack-System-Scope: None Jun 30 18:29:56.929778 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: User-Agent: python-urllib3/1.26.9 Jun 30 18:29:56.929778 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Auth-Token: gAAAAABivetSDIIqIsymnhD54LPtThV0zwF_CO3V_BqU3Cm3FvwZU_xXmGhfFDfXaFYAQ-z_yHgqSAVQBY8MiKVEpq_nIbPDN5LyoItcZOzYRXLHb89jO6vaUHRMPtzAwcCtbo4TxkLybjMEe69uWz73EpZunXiLaiGuy6yd65_ZV431ml5mKyo Jun 30 18:29:56.929778 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Id: None Jun 30 18:29:56.929778 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Name: None Jun 30 18:29:56.929778 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Identity-Status: Confirmed Jun 30 18:29:56.929778 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Is-Admin-Project: True Jun 30 18:29:56.929778 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Id: default Jun 30 18:29:56.929778 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Name: Default Jun 30 18:29:56.929778 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Id: e96b506102ab4528956023c5e0f3dbcf Jun 30 18:29:56.929778 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Name: tempest-DeleteServersTestJSON-751316779 Jun 30 18:29:56.929778 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Role: reader,member Jun 30 18:29:56.929778 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Roles: reader,member Jun 30 18:29:56.931336 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e96b506102ab4528956023c5e0f3dbcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e96b506102ab4528956023c5e0f3dbcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e96b506102ab4528956023c5e0f3dbcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e96b506102ab4528956023c5e0f3dbcf"}]}] Jun 30 18:29:56.931336 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant: tempest-DeleteServersTestJSON-751316779 Jun 30 18:29:56.931336 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Id: e96b506102ab4528956023c5e0f3dbcf Jun 30 18:29:56.931336 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Name: tempest-DeleteServersTestJSON-751316779 Jun 30 18:29:56.931336 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User: tempest-DeleteServersTestJSON-751316779-project Jun 30 18:29:56.931336 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Id: default Jun 30 18:29:56.931336 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Name: Default Jun 30 18:29:56.931336 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Id: db9762ad11e24246aefe2905eafe83f1 Jun 30 18:29:56.931336 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Name: tempest-DeleteServersTestJSON-751316779-project Jun 30 18:29:56.931336 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: method: > Jun 30 18:29:56.931336 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: exception: Instance 799aa3ef-4fdf-40c0-b76b-52ce98a386e8 could not be found. Jun 30 18:29:56.931336 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: action_args: {'id': '799aa3ef-4fdf-40c0-b76b-52ce98a386e8'} Jun 30 18:29:56.932120 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:29:56.932120 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:29:56.932120 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:29:56.932120 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:29:56.932120 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:29:56.932120 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:29:56.932120 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:29:56.932120 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:29:56.932120 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:29:56.932120 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:29:56.932120 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 799aa3ef-4fdf-40c0-b76b-52ce98a386e8 could not be found. Jun 30 18:29:56.932120 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:29:56.932120 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:29:56.932120 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:29:56.932120 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:29:56.932120 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:29:56.932120 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:29:56.932120 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:29:56.932120 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:29:56.932120 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:29:56.933392 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:29:56.933392 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 18:29:56.933392 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 18:29:56.933392 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 18:29:56.933392 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 18:29:56.933392 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:29:56.933392 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:29:56.933392 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:29:56.933392 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:29:56.933392 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 799aa3ef-4fdf-40c0-b76b-52ce98a386e8 could not be found. Jun 30 18:29:56.933392 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:29:56.933392 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:29:56.933392 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:29:56.933392 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:29:56.933392 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:29:56.933392 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:29:56.933392 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:29:56.933392 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:29:56.933392 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 799aa3ef-4fdf-40c0-b76b-52ce98a386e8 could not be found. Jun 30 18:29:56.933392 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:29:56.936035 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-7701350c-9ec3-47d8-94d7-6f7813d1e393 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Returning 404 to user: Instance 799aa3ef-4fdf-40c0-b76b-52ce98a386e8 could not be found. {{(pid=117940) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:29:56.938609 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-7701350c-9ec3-47d8-94d7-6f7813d1e393 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "DELETE /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 404 len: 111 microversion: 2.1 time: 0.052197 Jun 30 18:29:56.939592 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 135/261] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 30 18:29:56 2022] DELETE /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:29:56.953938 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-03d54eaa-1c87-45c6-9ad5-f15ad0a96dc5 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:56.954831 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-03d54eaa-1c87-45c6-9ad5-f15ad0a96dc5 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] [instance: 799aa3ef-4fdf-40c0-b76b-52ce98a386e8] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:56.962198 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-03d54eaa-1c87-45c6-9ad5-f15ad0a96dc5 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:56.963024 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-03d54eaa-1c87-45c6-9ad5-f15ad0a96dc5 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:56.963909 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-03d54eaa-1c87-45c6-9ad5-f15ad0a96dc5 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:56.964408 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-03d54eaa-1c87-45c6-9ad5-f15ad0a96dc5 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:56.980540 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.wsgi [None req-03d54eaa-1c87-45c6-9ad5-f15ad0a96dc5 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] HTTP exception thrown: Instance 799aa3ef-4fdf-40c0-b76b-52ce98a386e8 could not be found. Jun 30 18:29:56.985388 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-03d54eaa-1c87-45c6-9ad5-f15ad0a96dc5 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Request method failure captured: Jun 30 18:29:56.985388 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: request: GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 HTTP/1.1 Jun 30 18:29:56.985388 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept: application/json Jun 30 18:29:56.985388 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept-Encoding: identity Jun 30 18:29:56.985388 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Connection: close Jun 30 18:29:56.985388 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Length: 0 Jun 30 18:29:56.985388 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Type: application/json Jun 30 18:29:56.985388 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Host: 10.222.0.33 Jun 30 18:29:56.985388 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Openstack-System-Scope: None Jun 30 18:29:56.985388 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: User-Agent: python-urllib3/1.26.9 Jun 30 18:29:56.985388 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Auth-Token: gAAAAABivetSDIIqIsymnhD54LPtThV0zwF_CO3V_BqU3Cm3FvwZU_xXmGhfFDfXaFYAQ-z_yHgqSAVQBY8MiKVEpq_nIbPDN5LyoItcZOzYRXLHb89jO6vaUHRMPtzAwcCtbo4TxkLybjMEe69uWz73EpZunXiLaiGuy6yd65_ZV431ml5mKyo Jun 30 18:29:56.985388 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Id: None Jun 30 18:29:56.985388 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Name: None Jun 30 18:29:56.985388 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Identity-Status: Confirmed Jun 30 18:29:56.985388 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Is-Admin-Project: True Jun 30 18:29:56.985388 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Id: default Jun 30 18:29:56.985388 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Name: Default Jun 30 18:29:56.985388 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Id: e96b506102ab4528956023c5e0f3dbcf Jun 30 18:29:56.985388 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Name: tempest-DeleteServersTestJSON-751316779 Jun 30 18:29:56.985388 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Role: reader,member Jun 30 18:29:56.985388 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Roles: reader,member Jun 30 18:29:56.986918 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e96b506102ab4528956023c5e0f3dbcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e96b506102ab4528956023c5e0f3dbcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e96b506102ab4528956023c5e0f3dbcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e96b506102ab4528956023c5e0f3dbcf"}]}] Jun 30 18:29:56.986918 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant: tempest-DeleteServersTestJSON-751316779 Jun 30 18:29:56.986918 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Id: e96b506102ab4528956023c5e0f3dbcf Jun 30 18:29:56.986918 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Name: tempest-DeleteServersTestJSON-751316779 Jun 30 18:29:56.986918 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User: tempest-DeleteServersTestJSON-751316779-project Jun 30 18:29:56.986918 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Id: default Jun 30 18:29:56.986918 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Name: Default Jun 30 18:29:56.986918 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Id: db9762ad11e24246aefe2905eafe83f1 Jun 30 18:29:56.986918 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Name: tempest-DeleteServersTestJSON-751316779-project Jun 30 18:29:56.986918 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: method: > Jun 30 18:29:56.986918 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: exception: Instance 799aa3ef-4fdf-40c0-b76b-52ce98a386e8 could not be found. Jun 30 18:29:56.986918 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: action_args: {'id': '799aa3ef-4fdf-40c0-b76b-52ce98a386e8'} Jun 30 18:29:56.987710 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:29:56.987710 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:29:56.987710 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:29:56.987710 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:29:56.987710 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:29:56.987710 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:29:56.987710 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:29:56.987710 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:29:56.987710 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:29:56.987710 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:29:56.987710 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 799aa3ef-4fdf-40c0-b76b-52ce98a386e8 could not be found. Jun 30 18:29:56.987710 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:29:56.987710 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:29:56.987710 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:29:56.987710 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:29:56.987710 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:29:56.987710 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:29:56.987710 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:29:56.987710 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:29:56.987710 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:29:56.989104 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:29:56.989104 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:29:56.989104 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:29:56.989104 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:29:56.989104 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:29:56.989104 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:29:56.989104 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:29:56.989104 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 799aa3ef-4fdf-40c0-b76b-52ce98a386e8 could not be found. Jun 30 18:29:56.989104 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:29:56.989104 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:29:56.989104 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:29:56.989104 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:29:56.989104 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:29:56.989104 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:29:56.989104 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:29:56.989104 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:29:56.989104 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 799aa3ef-4fdf-40c0-b76b-52ce98a386e8 could not be found. Jun 30 18:29:56.989104 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:29:56.990323 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-03d54eaa-1c87-45c6-9ad5-f15ad0a96dc5 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] Returning 404 to user: Instance 799aa3ef-4fdf-40c0-b76b-52ce98a386e8 could not be found. {{(pid=117941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:29:56.990323 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-03d54eaa-1c87-45c6-9ad5-f15ad0a96dc5 tempest-DeleteServersTestJSON-751316779 tempest-DeleteServersTestJSON-751316779-project] 10.222.0.33 "GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8" status: 404 len: 111 microversion: 2.1 time: 0.039372 Jun 30 18:29:56.990323 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 127/262] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:56 2022] GET /compute/v2.1/servers/799aa3ef-4fdf-40c0-b76b-52ce98a386e8 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:29:57.815365 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-9f4bf06d-e37d-404d-9801-cbfa82cce4ff tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:57.816438 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-9f4bf06d-e37d-404d-9801-cbfa82cce4ff tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:57.822880 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9f4bf06d-e37d-404d-9801-cbfa82cce4ff tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:57.823629 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9f4bf06d-e37d-404d-9801-cbfa82cce4ff tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:57.824558 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9f4bf06d-e37d-404d-9801-cbfa82cce4ff tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:57.825149 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9f4bf06d-e37d-404d-9801-cbfa82cce4ff tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:58.187784 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-9f4bf06d-e37d-404d-9801-cbfa82cce4ff tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:58.198089 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-9f4bf06d-e37d-404d-9801-cbfa82cce4ff tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1521 microversion: 2.1 time: 0.387327 Jun 30 18:29:58.198687 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 136/263] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:57 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1521 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:29:59.215652 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-5cf9385f-ee6f-476c-92a5-d6a2451eaa0c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:59.217721 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-5cf9385f-ee6f-476c-92a5-d6a2451eaa0c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:59.224831 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-5cf9385f-ee6f-476c-92a5-d6a2451eaa0c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:59.225264 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-5cf9385f-ee6f-476c-92a5-d6a2451eaa0c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:59.226050 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-5cf9385f-ee6f-476c-92a5-d6a2451eaa0c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:59.226511 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-5cf9385f-ee6f-476c-92a5-d6a2451eaa0c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:59.423034 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-5cf9385f-ee6f-476c-92a5-d6a2451eaa0c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:59.430987 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-5cf9385f-ee6f-476c-92a5-d6a2451eaa0c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1521 microversion: 2.1 time: 0.219202 Jun 30 18:29:59.438341 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 128/264] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:59 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:00.449021 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-096a94af-9531-43f4-a1e3-b86bcff68597 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:00.449525 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-096a94af-9531-43f4-a1e3-b86bcff68597 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:00.456666 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-096a94af-9531-43f4-a1e3-b86bcff68597 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:00.457244 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-096a94af-9531-43f4-a1e3-b86bcff68597 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:00.458159 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-096a94af-9531-43f4-a1e3-b86bcff68597 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:00.459503 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-096a94af-9531-43f4-a1e3-b86bcff68597 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:00.662142 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-096a94af-9531-43f4-a1e3-b86bcff68597 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:00.678798 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-096a94af-9531-43f4-a1e3-b86bcff68597 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1521 microversion: 2.1 time: 0.234057 Jun 30 18:30:00.690094 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 137/265] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:00 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:01.696600 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-d9348527-7b8e-4d14-8f36-b914b9088e6a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:01.697210 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-d9348527-7b8e-4d14-8f36-b914b9088e6a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:01.704248 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d9348527-7b8e-4d14-8f36-b914b9088e6a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:01.704702 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d9348527-7b8e-4d14-8f36-b914b9088e6a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:01.705458 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d9348527-7b8e-4d14-8f36-b914b9088e6a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:01.705924 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d9348527-7b8e-4d14-8f36-b914b9088e6a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:01.848770 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-d9348527-7b8e-4d14-8f36-b914b9088e6a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:01.853097 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell1:SELECT=100 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:30:01.867896 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-d9348527-7b8e-4d14-8f36-b914b9088e6a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1521 microversion: 2.1 time: 0.175294 Jun 30 18:30:01.868918 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 129/266] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:01 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:02.885261 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-258219fe-c4aa-4d43-9dce-d2e692b051d3 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:02.886044 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-258219fe-c4aa-4d43-9dce-d2e692b051d3 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:02.893123 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-258219fe-c4aa-4d43-9dce-d2e692b051d3 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:02.893569 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-258219fe-c4aa-4d43-9dce-d2e692b051d3 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:02.894510 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-258219fe-c4aa-4d43-9dce-d2e692b051d3 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:02.894959 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-258219fe-c4aa-4d43-9dce-d2e692b051d3 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:03.118998 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-258219fe-c4aa-4d43-9dce-d2e692b051d3 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:03.130869 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-258219fe-c4aa-4d43-9dce-d2e692b051d3 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1521 microversion: 2.1 time: 0.249360 Jun 30 18:30:03.131460 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 138/267] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:02 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:04.152214 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-a7f15d22-beb7-4116-bad5-c65b26cd86a2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:04.155138 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-a7f15d22-beb7-4116-bad5-c65b26cd86a2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:04.163201 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a7f15d22-beb7-4116-bad5-c65b26cd86a2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:04.163649 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a7f15d22-beb7-4116-bad5-c65b26cd86a2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:04.164420 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a7f15d22-beb7-4116-bad5-c65b26cd86a2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:04.164856 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a7f15d22-beb7-4116-bad5-c65b26cd86a2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:04.313132 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-a7f15d22-beb7-4116-bad5-c65b26cd86a2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:04.321885 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-a7f15d22-beb7-4116-bad5-c65b26cd86a2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1521 microversion: 2.1 time: 0.177223 Jun 30 18:30:04.322679 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 130/268] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:04 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:05.341178 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-7b573b74-f1a7-4c9d-8f31-42c01e846d26 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:05.343249 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-7b573b74-f1a7-4c9d-8f31-42c01e846d26 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:05.346533 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:30:05.350929 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7b573b74-f1a7-4c9d-8f31-42c01e846d26 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:05.351492 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7b573b74-f1a7-4c9d-8f31-42c01e846d26 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:05.352663 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7b573b74-f1a7-4c9d-8f31-42c01e846d26 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:05.353210 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7b573b74-f1a7-4c9d-8f31-42c01e846d26 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:05.612936 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-7b573b74-f1a7-4c9d-8f31-42c01e846d26 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:05.625733 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-7b573b74-f1a7-4c9d-8f31-42c01e846d26 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1521 microversion: 2.1 time: 0.289361 Jun 30 18:30:05.627707 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 139/269] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:05 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:06.644402 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-05e8317a-be4c-4382-9831-66e09e906364 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:06.645011 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-05e8317a-be4c-4382-9831-66e09e906364 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:06.652520 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-05e8317a-be4c-4382-9831-66e09e906364 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:06.653226 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-05e8317a-be4c-4382-9831-66e09e906364 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:06.655690 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-05e8317a-be4c-4382-9831-66e09e906364 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:06.656228 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-05e8317a-be4c-4382-9831-66e09e906364 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:06.873502 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-05e8317a-be4c-4382-9831-66e09e906364 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:06.887745 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-05e8317a-be4c-4382-9831-66e09e906364 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1521 microversion: 2.1 time: 0.247040 Jun 30 18:30:06.904520 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 131/270] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:06 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:06.941958 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-d2776bf8-aff4-41f1-aa5e-6187babe7e8f tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Action: 'create', calling method: .version_select at 0x7f18055d1280>, body: {"keypair": {"name": "tempest-keypair-725038416", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLkVb4y9icdHJRvSrNWVuQ/8uLRTSYFtBgrawrCIkGB6sc3n47yinvl5yL859ryuyT/WQaCQkLgEfsJMTAWD5toU9lI4VVwuRWLWFrwIAwDZ/QaLOI6SyKXWYLrK1SVMg=="}} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:30:06.976243 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.quota [None req-d2776bf8-aff4-41f1-aa5e-6187babe7e8f tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Getting quotas for project 76384f04296b43b69e675de14cf1a55a. Resources: {'key_pairs'} {{(pid=117940) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 18:30:06.980813 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.quota [None req-d2776bf8-aff4-41f1-aa5e-6187babe7e8f tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Getting quotas for user 6ac4fc6cab4f47ea910ffdbed0a8e5b8 and project 76384f04296b43b69e675de14cf1a55a. Resources: {'key_pairs'} {{(pid=117940) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 18:30:07.032382 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-d2776bf8-aff4-41f1-aa5e-6187babe7e8f tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.347967 Jun 30 18:30:07.032958 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 140/271] 10.222.0.33 () {60 vars in 1158 bytes} [Thu Jun 30 18:30:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:30:07.929827 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-6436ea88-04e7-4885-b6d8-97129fe9f1ea tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:07.931574 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-6436ea88-04e7-4885-b6d8-97129fe9f1ea tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:07.939924 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6436ea88-04e7-4885-b6d8-97129fe9f1ea tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:07.940393 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6436ea88-04e7-4885-b6d8-97129fe9f1ea tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:07.941153 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6436ea88-04e7-4885-b6d8-97129fe9f1ea tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:07.941637 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6436ea88-04e7-4885-b6d8-97129fe9f1ea tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:08.177981 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-6436ea88-04e7-4885-b6d8-97129fe9f1ea tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:08.186396 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-6436ea88-04e7-4885-b6d8-97129fe9f1ea tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1521 microversion: 2.1 time: 0.263459 Jun 30 18:30:08.187384 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 132/272] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:07 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:08.749442 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-a0cea4db-6d41-4ecb-ad2f-04b8f16648ef tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-738062156", "imageRef": "636d6d52-5033-47e1-bf75-0b4fc50c0bb0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fe4fb437-870b-4a13-920f-45455dbbc61c"}], "security_groups": [{"name": "tempest-securitygroup--1474989640"}], "key_name": "tempest-keypair-725038416", "user_data": "}} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:30:09.204953 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-e0328573-569a-4058-8363-647ed9c1801f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:09.205495 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-e0328573-569a-4058-8363-647ed9c1801f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:09.213828 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e0328573-569a-4058-8363-647ed9c1801f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:09.214267 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e0328573-569a-4058-8363-647ed9c1801f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:09.215024 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e0328573-569a-4058-8363-647ed9c1801f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:09.215481 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e0328573-569a-4058-8363-647ed9c1801f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:09.376990 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-e0328573-569a-4058-8363-647ed9c1801f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:09.384432 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-e0328573-569a-4058-8363-647ed9c1801f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1521 microversion: 2.1 time: 0.184211 Jun 30 18:30:09.385024 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 133/273] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:09 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:30:10.402195 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-14c8d76c-193a-4037-afb0-d078476090cf tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:10.403825 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-14c8d76c-193a-4037-afb0-d078476090cf tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:10.411982 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-14c8d76c-193a-4037-afb0-d078476090cf tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:10.412431 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-14c8d76c-193a-4037-afb0-d078476090cf tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:10.413204 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-14c8d76c-193a-4037-afb0-d078476090cf tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:10.413715 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-14c8d76c-193a-4037-afb0-d078476090cf tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:10.578185 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-14c8d76c-193a-4037-afb0-d078476090cf tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:10.589203 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-14c8d76c-193a-4037-afb0-d078476090cf tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1521 microversion: 2.1 time: 0.191452 Jun 30 18:30:10.589840 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 134/274] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:10 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:11.605697 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-8f4b4617-ee38-4e36-aea0-fdcaf96570c9 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:11.607143 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-8f4b4617-ee38-4e36-aea0-fdcaf96570c9 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:11.615218 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8f4b4617-ee38-4e36-aea0-fdcaf96570c9 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:11.615953 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8f4b4617-ee38-4e36-aea0-fdcaf96570c9 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:11.617086 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8f4b4617-ee38-4e36-aea0-fdcaf96570c9 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:11.618315 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8f4b4617-ee38-4e36-aea0-fdcaf96570c9 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:11.826348 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-8f4b4617-ee38-4e36-aea0-fdcaf96570c9 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:11.836178 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-8f4b4617-ee38-4e36-aea0-fdcaf96570c9 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1521 microversion: 2.1 time: 0.234767 Jun 30 18:30:11.846883 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 135/275] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:11 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:30:12.854672 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-d080aed0-0ae8-4eb6-b6bc-62dfcc22adee tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:12.855268 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-d080aed0-0ae8-4eb6-b6bc-62dfcc22adee tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:12.861464 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d080aed0-0ae8-4eb6-b6bc-62dfcc22adee tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:12.861932 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d080aed0-0ae8-4eb6-b6bc-62dfcc22adee tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:12.862766 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d080aed0-0ae8-4eb6-b6bc-62dfcc22adee tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:12.863181 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d080aed0-0ae8-4eb6-b6bc-62dfcc22adee tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:13.030691 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-d080aed0-0ae8-4eb6-b6bc-62dfcc22adee tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:13.038536 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-d080aed0-0ae8-4eb6-b6bc-62dfcc22adee tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1521 microversion: 2.1 time: 0.187884 Jun 30 18:30:13.040877 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 136/276] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:12 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:14.064007 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-175f3f16-2f00-49e2-b01e-0adbe43679e9 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:14.064881 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-175f3f16-2f00-49e2-b01e-0adbe43679e9 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:14.071411 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-175f3f16-2f00-49e2-b01e-0adbe43679e9 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:14.071858 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-175f3f16-2f00-49e2-b01e-0adbe43679e9 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:14.072616 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-175f3f16-2f00-49e2-b01e-0adbe43679e9 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:14.073047 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-175f3f16-2f00-49e2-b01e-0adbe43679e9 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:14.203755 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-175f3f16-2f00-49e2-b01e-0adbe43679e9 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:14.213418 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-175f3f16-2f00-49e2-b01e-0adbe43679e9 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1521 microversion: 2.1 time: 0.153826 Jun 30 18:30:14.213952 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 137/277] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:14 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:30:15.230270 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-39ca721b-576d-4857-bb8b-f56aec70e5d6 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:15.230913 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-39ca721b-576d-4857-bb8b-f56aec70e5d6 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:15.237264 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-39ca721b-576d-4857-bb8b-f56aec70e5d6 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:15.237743 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-39ca721b-576d-4857-bb8b-f56aec70e5d6 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:15.238497 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-39ca721b-576d-4857-bb8b-f56aec70e5d6 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:15.238926 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-39ca721b-576d-4857-bb8b-f56aec70e5d6 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:15.368227 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-39ca721b-576d-4857-bb8b-f56aec70e5d6 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:15.377363 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-39ca721b-576d-4857-bb8b-f56aec70e5d6 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1521 microversion: 2.1 time: 0.150544 Jun 30 18:30:15.377981 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 138/278] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:15 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:30:15.620068 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell1:SELECT=36 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:30:16.396771 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-aa255a9b-ff1e-44ad-90d8-3f6fad3bdfde tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:16.397759 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-aa255a9b-ff1e-44ad-90d8-3f6fad3bdfde tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:16.406283 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-aa255a9b-ff1e-44ad-90d8-3f6fad3bdfde tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:16.406729 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-aa255a9b-ff1e-44ad-90d8-3f6fad3bdfde tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:16.407485 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-aa255a9b-ff1e-44ad-90d8-3f6fad3bdfde tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:16.407915 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-aa255a9b-ff1e-44ad-90d8-3f6fad3bdfde tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:16.568209 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.network.neutron [None req-a0cea4db-6d41-4ecb-ad2f-04b8f16648ef tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] validate_networks() for [('fe4fb437-870b-4a13-920f-45455dbbc61c', None, None, None, None, None)] {{(pid=117940) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 18:30:16.591671 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-aa255a9b-ff1e-44ad-90d8-3f6fad3bdfde tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:16.599371 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-aa255a9b-ff1e-44ad-90d8-3f6fad3bdfde tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1521 microversion: 2.1 time: 0.208338 Jun 30 18:30:16.600328 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 139/279] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:16 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:30:16.978735 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-a0cea4db-6d41-4ecb-ad2f-04b8f16648ef tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Flavor limits 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 18:30:16.979389 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-a0cea4db-6d41-4ecb-ad2f-04b8f16648ef tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Image limits 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 18:30:16.979612 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-a0cea4db-6d41-4ecb-ad2f-04b8f16648ef tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Flavor pref 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 18:30:16.980049 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-a0cea4db-6d41-4ecb-ad2f-04b8f16648ef tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Image pref 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 18:30:16.980422 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-a0cea4db-6d41-4ecb-ad2f-04b8f16648ef tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 18:30:16.990554 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a0cea4db-6d41-4ecb-ad2f-04b8f16648ef tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:16.991154 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a0cea4db-6d41-4ecb-ad2f-04b8f16648ef tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:16.992210 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a0cea4db-6d41-4ecb-ad2f-04b8f16648ef tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:16.992676 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a0cea4db-6d41-4ecb-ad2f-04b8f16648ef tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:17.010154 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.quota [None req-a0cea4db-6d41-4ecb-ad2f-04b8f16648ef tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Getting quotas for project 76384f04296b43b69e675de14cf1a55a. Resources: {'ram', 'instances', 'cores'} {{(pid=117940) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 18:30:17.014529 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.quota [None req-a0cea4db-6d41-4ecb-ad2f-04b8f16648ef tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Getting quotas for user 6ac4fc6cab4f47ea910ffdbed0a8e5b8 and project 76384f04296b43b69e675de14cf1a55a. Resources: {'ram', 'instances', 'cores'} {{(pid=117940) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 18:30:17.025271 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-a0cea4db-6d41-4ecb-ad2f-04b8f16648ef tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Going to run 1 instances... {{(pid=117940) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 18:30:17.027544 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-a0cea4db-6d41-4ecb-ad2f-04b8f16648ef tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='636d6d52-5033-47e1-bf75-0b4fc50c0bb0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117940) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 18:30:17.078723 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-a0cea4db-6d41-4ecb-ad2f-04b8f16648ef tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 8.334870 Jun 30 18:30:17.084289 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 141/280] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 30 18:30:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 8337 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 18:30:17.089299 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-7ac74184-5e22-4be9-994c-925d1e523f8b tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:17.091379 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-7ac74184-5e22-4be9-994c-925d1e523f8b tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:17.160713 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-7ac74184-5e22-4be9-994c-925d1e523f8b tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:17.169732 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-7ac74184-5e22-4be9-994c-925d1e523f8b tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1236 microversion: 2.1 time: 0.084194 Jun 30 18:30:17.170870 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 140/281] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:17 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1236 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:17.616709 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-06c61d6c-f4ab-44e9-8dec-ec73e5a92a59 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:17.617316 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-06c61d6c-f4ab-44e9-8dec-ec73e5a92a59 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:17.623796 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-06c61d6c-f4ab-44e9-8dec-ec73e5a92a59 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:17.624018 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-06c61d6c-f4ab-44e9-8dec-ec73e5a92a59 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:17.624922 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-06c61d6c-f4ab-44e9-8dec-ec73e5a92a59 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:17.625460 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-06c61d6c-f4ab-44e9-8dec-ec73e5a92a59 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:17.757939 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-06c61d6c-f4ab-44e9-8dec-ec73e5a92a59 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:17.765665 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-06c61d6c-f4ab-44e9-8dec-ec73e5a92a59 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1521 microversion: 2.1 time: 0.152876 Jun 30 18:30:17.766243 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 142/282] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:17 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:18.186584 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-7491d30e-ee88-455b-9d32-cd8130a00b5c tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:18.187287 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-7491d30e-ee88-455b-9d32-cd8130a00b5c tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:18.194035 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7491d30e-ee88-455b-9d32-cd8130a00b5c tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:18.194481 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7491d30e-ee88-455b-9d32-cd8130a00b5c tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:18.195238 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7491d30e-ee88-455b-9d32-cd8130a00b5c tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:18.195670 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7491d30e-ee88-455b-9d32-cd8130a00b5c tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:18.266983 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-7491d30e-ee88-455b-9d32-cd8130a00b5c tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:18.274678 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-7491d30e-ee88-455b-9d32-cd8130a00b5c tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1240 microversion: 2.1 time: 0.092048 Jun 30 18:30:18.275240 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 141/283] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:18 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1240 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:18.784051 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-00931797-e805-4f3e-a5ed-46bcf95023b4 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:18.785614 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-00931797-e805-4f3e-a5ed-46bcf95023b4 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:18.796640 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-00931797-e805-4f3e-a5ed-46bcf95023b4 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:18.798758 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-00931797-e805-4f3e-a5ed-46bcf95023b4 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:18.798758 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-00931797-e805-4f3e-a5ed-46bcf95023b4 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:18.798758 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-00931797-e805-4f3e-a5ed-46bcf95023b4 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:18.945604 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-00931797-e805-4f3e-a5ed-46bcf95023b4 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:18.955416 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-00931797-e805-4f3e-a5ed-46bcf95023b4 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1521 microversion: 2.1 time: 0.176197 Jun 30 18:30:18.956029 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 143/284] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:18 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:19.302028 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-7efb6891-0252-4814-a8dd-194add4f67d7 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:19.303063 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-7efb6891-0252-4814-a8dd-194add4f67d7 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:19.310432 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7efb6891-0252-4814-a8dd-194add4f67d7 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:19.310908 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7efb6891-0252-4814-a8dd-194add4f67d7 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:19.311693 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7efb6891-0252-4814-a8dd-194add4f67d7 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:19.312127 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7efb6891-0252-4814-a8dd-194add4f67d7 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:19.381164 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-7efb6891-0252-4814-a8dd-194add4f67d7 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:19.391036 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-7efb6891-0252-4814-a8dd-194add4f67d7 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1288 microversion: 2.1 time: 0.099484 Jun 30 18:30:19.392147 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 142/285] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:19 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1288 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:19.973051 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-1721e7d2-241a-4f63-9969-36e6eccd64ca tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:19.974047 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-1721e7d2-241a-4f63-9969-36e6eccd64ca tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:19.981080 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-1721e7d2-241a-4f63-9969-36e6eccd64ca tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:19.981615 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-1721e7d2-241a-4f63-9969-36e6eccd64ca tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:19.982448 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-1721e7d2-241a-4f63-9969-36e6eccd64ca tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:19.982940 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-1721e7d2-241a-4f63-9969-36e6eccd64ca tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:20.185354 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-1721e7d2-241a-4f63-9969-36e6eccd64ca tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:20.203372 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-1721e7d2-241a-4f63-9969-36e6eccd64ca tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1521 microversion: 2.1 time: 0.235722 Jun 30 18:30:20.204052 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 144/286] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:19 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:20.411943 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-f83a27d1-7b87-4f9b-ab35-901f2ae07155 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:20.412661 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-f83a27d1-7b87-4f9b-ab35-901f2ae07155 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:20.419667 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f83a27d1-7b87-4f9b-ab35-901f2ae07155 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:20.420470 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f83a27d1-7b87-4f9b-ab35-901f2ae07155 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:20.421491 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f83a27d1-7b87-4f9b-ab35-901f2ae07155 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:20.422106 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f83a27d1-7b87-4f9b-ab35-901f2ae07155 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:20.503949 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-f83a27d1-7b87-4f9b-ab35-901f2ae07155 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:20.511852 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-f83a27d1-7b87-4f9b-ab35-901f2ae07155 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1294 microversion: 2.1 time: 0.103959 Jun 30 18:30:20.512603 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 143/287] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:20 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1294 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:21.220209 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-aff8b5fd-17f9-4a0f-8cd8-a4403523b8bb tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:21.221374 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-aff8b5fd-17f9-4a0f-8cd8-a4403523b8bb tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:21.227292 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-aff8b5fd-17f9-4a0f-8cd8-a4403523b8bb tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:21.227731 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-aff8b5fd-17f9-4a0f-8cd8-a4403523b8bb tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:21.228519 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-aff8b5fd-17f9-4a0f-8cd8-a4403523b8bb tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:21.229676 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-aff8b5fd-17f9-4a0f-8cd8-a4403523b8bb tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:21.383499 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-aff8b5fd-17f9-4a0f-8cd8-a4403523b8bb tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:21.400798 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-aff8b5fd-17f9-4a0f-8cd8-a4403523b8bb tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1501 microversion: 2.1 time: 0.184367 Jun 30 18:30:21.401782 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 145/288] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:21 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1501 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:21.421296 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-adbc9eb1-72f4-4d4b-8f76-4072dd023d82 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:21.422433 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-adbc9eb1-72f4-4d4b-8f76-4072dd023d82 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: d6c61f3b-a138-4d3c-971d-8f25d3124178] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:21.425648 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_api:SELECT=50 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:30:21.433458 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-adbc9eb1-72f4-4d4b-8f76-4072dd023d82 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:21.434088 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-adbc9eb1-72f4-4d4b-8f76-4072dd023d82 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:21.435267 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-adbc9eb1-72f4-4d4b-8f76-4072dd023d82 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:21.436352 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-adbc9eb1-72f4-4d4b-8f76-4072dd023d82 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:21.536030 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-e098cfa7-5546-4964-9628-fd2d924f520d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:21.536639 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-e098cfa7-5546-4964-9628-fd2d924f520d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:21.543855 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e098cfa7-5546-4964-9628-fd2d924f520d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:21.543969 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e098cfa7-5546-4964-9628-fd2d924f520d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:21.544727 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e098cfa7-5546-4964-9628-fd2d924f520d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:21.545152 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e098cfa7-5546-4964-9628-fd2d924f520d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:21.603197 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-adbc9eb1-72f4-4d4b-8f76-4072dd023d82 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:21.612158 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-adbc9eb1-72f4-4d4b-8f76-4072dd023d82 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178" status: 200 len: 1515 microversion: 2.1 time: 0.197353 Jun 30 18:30:21.613077 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 144/289] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:21 2022] GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178 => generated 1515 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:21.716066 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-e098cfa7-5546-4964-9628-fd2d924f520d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:21.753891 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-e098cfa7-5546-4964-9628-fd2d924f520d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1362 microversion: 2.1 time: 0.227311 Jun 30 18:30:21.755738 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 146/290] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:21 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1362 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:30:22.267173 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-83ca619f-724e-416c-8c76-c2a2176da436 req-4a3ffab0-3b7f-4861-ade6-adcdd86ee713 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e559236-fa0a-4378-b21f-e5f5e669751d", "tag": "2523b467-c01d-4854-a427-8bf6153c35b2"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:30:22.279343 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-83ca619f-724e-416c-8c76-c2a2176da436 req-4a3ffab0-3b7f-4861-ade6-adcdd86ee713 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:22.280450 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-83ca619f-724e-416c-8c76-c2a2176da436 req-4a3ffab0-3b7f-4861-ade6-adcdd86ee713 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:22.303075 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.compute.server_external_events [req-83ca619f-724e-416c-8c76-c2a2176da436 req-4a3ffab0-3b7f-4861-ade6-adcdd86ee713 service nova] Creating event network-changed:2523b467-c01d-4854-a427-8bf6153c35b2 for instance 2e559236-fa0a-4378-b21f-e5f5e669751d on hv-cinder-80378 Jun 30 18:30:22.308596 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-83ca619f-724e-416c-8c76-c2a2176da436 req-4a3ffab0-3b7f-4861-ade6-adcdd86ee713 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047093 Jun 30 18:30:22.309518 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 145/291] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:30:22.773136 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-5e8a9a5f-dd80-47fd-87b0-30b5bc1c5f84 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:22.773771 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-5e8a9a5f-dd80-47fd-87b0-30b5bc1c5f84 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:22.780312 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5e8a9a5f-dd80-47fd-87b0-30b5bc1c5f84 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:22.780970 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5e8a9a5f-dd80-47fd-87b0-30b5bc1c5f84 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:22.781757 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5e8a9a5f-dd80-47fd-87b0-30b5bc1c5f84 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:22.782203 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5e8a9a5f-dd80-47fd-87b0-30b5bc1c5f84 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:22.922532 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-5e8a9a5f-dd80-47fd-87b0-30b5bc1c5f84 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:22.931383 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-5e8a9a5f-dd80-47fd-87b0-30b5bc1c5f84 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1362 microversion: 2.1 time: 0.162441 Jun 30 18:30:22.932256 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 147/292] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:22 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:23.948850 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-41195612-3181-41de-a94a-22a2236cb53f tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:23.949448 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-41195612-3181-41de-a94a-22a2236cb53f tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:23.957992 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-41195612-3181-41de-a94a-22a2236cb53f tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:23.958431 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-41195612-3181-41de-a94a-22a2236cb53f tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:23.959184 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-41195612-3181-41de-a94a-22a2236cb53f tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:23.959607 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-41195612-3181-41de-a94a-22a2236cb53f tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:24.114004 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-41195612-3181-41de-a94a-22a2236cb53f tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:24.122500 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-41195612-3181-41de-a94a-22a2236cb53f tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1362 microversion: 2.1 time: 0.177852 Jun 30 18:30:24.123074 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 146/293] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:23 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:25.139506 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-903c4338-5ab7-4089-a727-1b775ae81f6f tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:25.140177 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-903c4338-5ab7-4089-a727-1b775ae81f6f tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:25.146239 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-903c4338-5ab7-4089-a727-1b775ae81f6f tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:25.146665 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-903c4338-5ab7-4089-a727-1b775ae81f6f tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:25.147417 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-903c4338-5ab7-4089-a727-1b775ae81f6f tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:25.147848 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-903c4338-5ab7-4089-a727-1b775ae81f6f tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:25.282448 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-903c4338-5ab7-4089-a727-1b775ae81f6f tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:25.300254 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-903c4338-5ab7-4089-a727-1b775ae81f6f tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1362 microversion: 2.1 time: 0.164708 Jun 30 18:30:25.300833 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 148/294] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:25 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:26.323798 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-1d95f4bb-dc74-4bb2-afde-28b77515c487 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:26.323798 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-1d95f4bb-dc74-4bb2-afde-28b77515c487 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:26.328760 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1d95f4bb-dc74-4bb2-afde-28b77515c487 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:26.329276 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1d95f4bb-dc74-4bb2-afde-28b77515c487 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:26.330566 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1d95f4bb-dc74-4bb2-afde-28b77515c487 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:26.331300 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1d95f4bb-dc74-4bb2-afde-28b77515c487 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:26.460063 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-1d95f4bb-dc74-4bb2-afde-28b77515c487 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:26.468036 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-1d95f4bb-dc74-4bb2-afde-28b77515c487 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1362 microversion: 2.1 time: 0.154599 Jun 30 18:30:26.468626 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 147/295] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:26 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:27.485661 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-19b2c39e-7eb7-4cb2-8f81-3d8712b2c3b0 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:27.486860 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-19b2c39e-7eb7-4cb2-8f81-3d8712b2c3b0 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:27.494144 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell0:SELECT=2 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:30:27.495311 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell0:SELECT=10 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:30:27.496960 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-19b2c39e-7eb7-4cb2-8f81-3d8712b2c3b0 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:27.497471 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-19b2c39e-7eb7-4cb2-8f81-3d8712b2c3b0 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:27.498828 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-19b2c39e-7eb7-4cb2-8f81-3d8712b2c3b0 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:27.499562 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-19b2c39e-7eb7-4cb2-8f81-3d8712b2c3b0 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:27.651759 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-19b2c39e-7eb7-4cb2-8f81-3d8712b2c3b0 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:27.665895 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-19b2c39e-7eb7-4cb2-8f81-3d8712b2c3b0 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1362 microversion: 2.1 time: 0.183876 Jun 30 18:30:27.667960 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 149/296] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:27 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:28.395568 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-28c7952e-8338-4adb-aeff-e253a7f7d7e6 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:30:28.397747 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-28c7952e-8338-4adb-aeff-e253a7f7d7e6 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: d6c61f3b-a138-4d3c-971d-8f25d3124178] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:28.404413 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell0:SELECT=2 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:30:28.407956 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-28c7952e-8338-4adb-aeff-e253a7f7d7e6 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:28.409045 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-28c7952e-8338-4adb-aeff-e253a7f7d7e6 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:28.410034 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-28c7952e-8338-4adb-aeff-e253a7f7d7e6 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:28.411007 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-28c7952e-8338-4adb-aeff-e253a7f7d7e6 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:28.429032 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell1:SELECT=100 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:30:28.454467 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.objects.instance [None req-28c7952e-8338-4adb-aeff-e253a7f7d7e6 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lazy-loading 'flavor' on Instance uuid d6c61f3b-a138-4d3c-971d-8f25d3124178 {{(pid=117941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 18:30:28.598862 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-28c7952e-8338-4adb-aeff-e253a7f7d7e6 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "POST /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178/action" status: 200 len: 32 microversion: 2.1 time: 0.210583 Jun 30 18:30:28.599478 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 148/297] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 30 18:30:28 2022] POST /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178/action => generated 32 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 18:30:28.610389 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-7be6cc90-e81c-419d-acf2-26b11485b66f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:28.612268 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-7be6cc90-e81c-419d-acf2-26b11485b66f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: d6c61f3b-a138-4d3c-971d-8f25d3124178] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:28.620350 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7be6cc90-e81c-419d-acf2-26b11485b66f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:28.620817 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7be6cc90-e81c-419d-acf2-26b11485b66f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:28.623916 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7be6cc90-e81c-419d-acf2-26b11485b66f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:28.624432 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7be6cc90-e81c-419d-acf2-26b11485b66f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:28.685473 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-31dc8399-ed0f-4e77-a53c-198ce3ccc5d8 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:28.686547 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-31dc8399-ed0f-4e77-a53c-198ce3ccc5d8 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:28.695518 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-31dc8399-ed0f-4e77-a53c-198ce3ccc5d8 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:28.695965 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-31dc8399-ed0f-4e77-a53c-198ce3ccc5d8 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:28.696732 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-31dc8399-ed0f-4e77-a53c-198ce3ccc5d8 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:28.697161 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-31dc8399-ed0f-4e77-a53c-198ce3ccc5d8 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:28.860329 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-7be6cc90-e81c-419d-acf2-26b11485b66f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:28.894617 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-7be6cc90-e81c-419d-acf2-26b11485b66f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178" status: 200 len: 1521 microversion: 2.1 time: 0.279172 Jun 30 18:30:28.907514 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 150/298] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:28 2022] GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178 => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:28.940801 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-31dc8399-ed0f-4e77-a53c-198ce3ccc5d8 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:28.952574 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-31dc8399-ed0f-4e77-a53c-198ce3ccc5d8 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1362 microversion: 2.1 time: 0.272019 Jun 30 18:30:28.955781 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 149/299] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:28 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1362 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:29.915386 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-11b3c7d3-6335-4aa2-9422-c7a67b3d8ff5 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:29.915991 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-11b3c7d3-6335-4aa2-9422-c7a67b3d8ff5 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: d6c61f3b-a138-4d3c-971d-8f25d3124178] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:29.924901 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-11b3c7d3-6335-4aa2-9422-c7a67b3d8ff5 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:29.926211 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-11b3c7d3-6335-4aa2-9422-c7a67b3d8ff5 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:29.927095 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-11b3c7d3-6335-4aa2-9422-c7a67b3d8ff5 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:29.927579 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-11b3c7d3-6335-4aa2-9422-c7a67b3d8ff5 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:29.970817 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-82d96484-4478-4812-8201-ee427ba36448 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:29.972258 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-82d96484-4478-4812-8201-ee427ba36448 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:29.981231 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-82d96484-4478-4812-8201-ee427ba36448 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:29.981800 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-82d96484-4478-4812-8201-ee427ba36448 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:29.995506 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-82d96484-4478-4812-8201-ee427ba36448 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:29.995963 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-82d96484-4478-4812-8201-ee427ba36448 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:30.206401 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-11b3c7d3-6335-4aa2-9422-c7a67b3d8ff5 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:30.215595 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-82d96484-4478-4812-8201-ee427ba36448 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:30.222573 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-11b3c7d3-6335-4aa2-9422-c7a67b3d8ff5 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178" status: 200 len: 1521 microversion: 2.1 time: 0.310186 Jun 30 18:30:30.223429 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 151/300] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:29 2022] GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178 => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:30.226433 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-82d96484-4478-4812-8201-ee427ba36448 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1362 microversion: 2.1 time: 0.260142 Jun 30 18:30:30.236962 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 150/301] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:29 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1362 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:30:31.240318 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-dd203a8b-b13b-4975-9872-cbdf0067189a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:31.240931 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-dd203a8b-b13b-4975-9872-cbdf0067189a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: d6c61f3b-a138-4d3c-971d-8f25d3124178] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:31.244482 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-6cc6db44-a194-4ac6-8eca-1437c2ad0cbf tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:31.245091 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-6cc6db44-a194-4ac6-8eca-1437c2ad0cbf tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:31.247112 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-dd203a8b-b13b-4975-9872-cbdf0067189a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:31.247752 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-dd203a8b-b13b-4975-9872-cbdf0067189a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:31.249455 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-dd203a8b-b13b-4975-9872-cbdf0067189a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:31.250399 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-dd203a8b-b13b-4975-9872-cbdf0067189a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:31.255930 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6cc6db44-a194-4ac6-8eca-1437c2ad0cbf tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:31.256374 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6cc6db44-a194-4ac6-8eca-1437c2ad0cbf tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:31.257146 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6cc6db44-a194-4ac6-8eca-1437c2ad0cbf tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:31.257909 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6cc6db44-a194-4ac6-8eca-1437c2ad0cbf tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:31.490731 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-dd203a8b-b13b-4975-9872-cbdf0067189a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:31.501037 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-dd203a8b-b13b-4975-9872-cbdf0067189a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178" status: 200 len: 1521 microversion: 2.1 time: 0.264827 Jun 30 18:30:31.505021 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 152/302] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:31 2022] GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178 => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:31.547078 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-6cc6db44-a194-4ac6-8eca-1437c2ad0cbf tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:31.575072 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-6cc6db44-a194-4ac6-8eca-1437c2ad0cbf tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1362 microversion: 2.1 time: 0.334358 Jun 30 18:30:31.580487 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 151/303] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:31 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1362 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:30:32.521722 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-20df5249-28bc-4f1d-9aa8-1bfda7b77561 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:32.523286 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-20df5249-28bc-4f1d-9aa8-1bfda7b77561 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: d6c61f3b-a138-4d3c-971d-8f25d3124178] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:32.532150 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-20df5249-28bc-4f1d-9aa8-1bfda7b77561 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:32.532581 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-20df5249-28bc-4f1d-9aa8-1bfda7b77561 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:32.533339 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-20df5249-28bc-4f1d-9aa8-1bfda7b77561 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:32.533799 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-20df5249-28bc-4f1d-9aa8-1bfda7b77561 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:32.597822 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-d1f8f03c-1cd0-408a-a8c0-13636e940d6e tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:32.598337 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-d1f8f03c-1cd0-408a-a8c0-13636e940d6e tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:32.611371 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d1f8f03c-1cd0-408a-a8c0-13636e940d6e tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:32.612298 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d1f8f03c-1cd0-408a-a8c0-13636e940d6e tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:32.613171 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d1f8f03c-1cd0-408a-a8c0-13636e940d6e tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:32.613635 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d1f8f03c-1cd0-408a-a8c0-13636e940d6e tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:32.769829 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-20df5249-28bc-4f1d-9aa8-1bfda7b77561 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:32.781951 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-20df5249-28bc-4f1d-9aa8-1bfda7b77561 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178" status: 200 len: 1521 microversion: 2.1 time: 0.263949 Jun 30 18:30:32.783886 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 153/304] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:32 2022] GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178 => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:33.001556 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-d1f8f03c-1cd0-408a-a8c0-13636e940d6e tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:33.014657 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-d1f8f03c-1cd0-408a-a8c0-13636e940d6e tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1362 microversion: 2.1 time: 0.419018 Jun 30 18:30:33.016141 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 152/305] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:32 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1362 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:33.801219 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-c584fd05-3b8a-43f1-95cc-b0fe360df854 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:33.802462 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-c584fd05-3b8a-43f1-95cc-b0fe360df854 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: d6c61f3b-a138-4d3c-971d-8f25d3124178] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:33.808972 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c584fd05-3b8a-43f1-95cc-b0fe360df854 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:33.812072 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c584fd05-3b8a-43f1-95cc-b0fe360df854 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:33.815007 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c584fd05-3b8a-43f1-95cc-b0fe360df854 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:33.815881 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c584fd05-3b8a-43f1-95cc-b0fe360df854 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:34.034515 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-f2be6982-bfe8-4f45-bba5-e4040cc9fdb4 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:34.035171 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-f2be6982-bfe8-4f45-bba5-e4040cc9fdb4 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:34.041942 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f2be6982-bfe8-4f45-bba5-e4040cc9fdb4 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:34.042599 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f2be6982-bfe8-4f45-bba5-e4040cc9fdb4 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:34.043570 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f2be6982-bfe8-4f45-bba5-e4040cc9fdb4 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:34.044159 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f2be6982-bfe8-4f45-bba5-e4040cc9fdb4 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:34.072191 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-c584fd05-3b8a-43f1-95cc-b0fe360df854 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:34.081247 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-c584fd05-3b8a-43f1-95cc-b0fe360df854 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178" status: 200 len: 1521 microversion: 2.1 time: 0.284493 Jun 30 18:30:34.084559 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 154/306] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:33 2022] GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178 => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:34.271835 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-f2be6982-bfe8-4f45-bba5-e4040cc9fdb4 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:34.293307 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-f2be6982-bfe8-4f45-bba5-e4040cc9fdb4 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1362 microversion: 2.1 time: 0.263129 Jun 30 18:30:34.295240 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 153/307] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:34 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1362 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:35.104476 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-b9145240-eb4f-4212-a6b9-44e1b3434d93 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:35.105329 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-b9145240-eb4f-4212-a6b9-44e1b3434d93 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: d6c61f3b-a138-4d3c-971d-8f25d3124178] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:35.115003 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b9145240-eb4f-4212-a6b9-44e1b3434d93 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:35.117845 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b9145240-eb4f-4212-a6b9-44e1b3434d93 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:35.119044 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b9145240-eb4f-4212-a6b9-44e1b3434d93 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:35.124172 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b9145240-eb4f-4212-a6b9-44e1b3434d93 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:35.314412 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-44993cfe-d013-4d06-b75d-02fec2e935bc tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:35.316105 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-44993cfe-d013-4d06-b75d-02fec2e935bc tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:35.325706 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-44993cfe-d013-4d06-b75d-02fec2e935bc tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:35.328096 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-44993cfe-d013-4d06-b75d-02fec2e935bc tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:35.330572 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-44993cfe-d013-4d06-b75d-02fec2e935bc tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:35.331115 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-44993cfe-d013-4d06-b75d-02fec2e935bc tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:35.367059 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-b9145240-eb4f-4212-a6b9-44e1b3434d93 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:35.382164 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-b9145240-eb4f-4212-a6b9-44e1b3434d93 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178" status: 200 len: 1521 microversion: 2.1 time: 0.282618 Jun 30 18:30:35.382755 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 155/308] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:35 2022] GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178 => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:35.486279 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-44993cfe-d013-4d06-b75d-02fec2e935bc tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:35.497297 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-44993cfe-d013-4d06-b75d-02fec2e935bc tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1362 microversion: 2.1 time: 0.190305 Jun 30 18:30:35.507181 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 154/309] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:35 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1362 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:36.351859 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-dd0911d5-6409-4ced-9ad7-e5405ed19dc3 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2141897127", "imageRef": "636d6d52-5033-47e1-bf75-0b4fc50c0bb0", "flavorRef": "452", "networks": [{"uuid": "1f259826-30a8-477f-a1b0-8883730f55b5"}]}} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:30:36.363731 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:30:36.399334 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-0b3f9819-9198-491b-8b92-38415ec289ed tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:36.400055 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-0b3f9819-9198-491b-8b92-38415ec289ed tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: d6c61f3b-a138-4d3c-971d-8f25d3124178] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:36.406978 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0b3f9819-9198-491b-8b92-38415ec289ed tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:36.407497 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0b3f9819-9198-491b-8b92-38415ec289ed tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:36.408233 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0b3f9819-9198-491b-8b92-38415ec289ed tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:36.408689 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0b3f9819-9198-491b-8b92-38415ec289ed tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:36.578398 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-0b3f9819-9198-491b-8b92-38415ec289ed tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:36.585889 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-0b3f9819-9198-491b-8b92-38415ec289ed tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178" status: 200 len: 1521 microversion: 2.1 time: 0.190346 Jun 30 18:30:36.587068 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 155/310] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:36 2022] GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:30:36.591713 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-a0c5c040-c356-4f61-b5d6-6d4cdb09836d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:36.592428 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-a0c5c040-c356-4f61-b5d6-6d4cdb09836d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:36.598940 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a0c5c040-c356-4f61-b5d6-6d4cdb09836d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:36.599458 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a0c5c040-c356-4f61-b5d6-6d4cdb09836d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:36.600323 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a0c5c040-c356-4f61-b5d6-6d4cdb09836d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:36.600819 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a0c5c040-c356-4f61-b5d6-6d4cdb09836d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:36.793478 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-a0c5c040-c356-4f61-b5d6-6d4cdb09836d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:36.802475 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-a0c5c040-c356-4f61-b5d6-6d4cdb09836d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1362 microversion: 2.1 time: 0.214126 Jun 30 18:30:36.803290 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 156/311] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:36 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1362 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:37.387065 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.network.neutron [None req-dd0911d5-6409-4ced-9ad7-e5405ed19dc3 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] validate_networks() for [('1f259826-30a8-477f-a1b0-8883730f55b5', None, None, None, None, None)] {{(pid=117940) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 18:30:37.603257 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-53b9c3c7-6180-465c-bafd-885d91e4cf96 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:37.604495 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-53b9c3c7-6180-465c-bafd-885d91e4cf96 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: d6c61f3b-a138-4d3c-971d-8f25d3124178] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:37.611263 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-53b9c3c7-6180-465c-bafd-885d91e4cf96 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:37.612077 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-53b9c3c7-6180-465c-bafd-885d91e4cf96 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:37.613032 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-53b9c3c7-6180-465c-bafd-885d91e4cf96 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:37.613713 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-53b9c3c7-6180-465c-bafd-885d91e4cf96 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:38.069038 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-53b9c3c7-6180-465c-bafd-885d91e4cf96 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:38.080048 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-53b9c3c7-6180-465c-bafd-885d91e4cf96 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178" status: 200 len: 1521 microversion: 2.1 time: 0.480744 Jun 30 18:30:38.090005 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 157/312] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:37 2022] GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178 => generated 1521 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:30:38.095705 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-b477f841-b895-478b-a9a6-566595f24f8c tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:38.096000 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-dd0911d5-6409-4ced-9ad7-e5405ed19dc3 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Flavor limits 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 18:30:38.096310 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-b477f841-b895-478b-a9a6-566595f24f8c tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:38.096575 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-dd0911d5-6409-4ced-9ad7-e5405ed19dc3 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Image limits 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 18:30:38.097153 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-dd0911d5-6409-4ced-9ad7-e5405ed19dc3 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Flavor pref 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 18:30:38.097691 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-dd0911d5-6409-4ced-9ad7-e5405ed19dc3 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Image pref 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 18:30:38.098563 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-dd0911d5-6409-4ced-9ad7-e5405ed19dc3 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 18:30:38.102367 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b477f841-b895-478b-a9a6-566595f24f8c tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:38.102809 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b477f841-b895-478b-a9a6-566595f24f8c tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:38.103552 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b477f841-b895-478b-a9a6-566595f24f8c tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:38.104134 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b477f841-b895-478b-a9a6-566595f24f8c tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:38.107917 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-dd0911d5-6409-4ced-9ad7-e5405ed19dc3 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:38.109217 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-dd0911d5-6409-4ced-9ad7-e5405ed19dc3 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:38.110111 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-dd0911d5-6409-4ced-9ad7-e5405ed19dc3 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:38.110773 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-dd0911d5-6409-4ced-9ad7-e5405ed19dc3 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:38.128930 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.quota [None req-dd0911d5-6409-4ced-9ad7-e5405ed19dc3 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Getting quotas for project 116a07f168ef45e1b2f4e7a084fba32c. Resources: {'ram', 'instances', 'cores'} {{(pid=117940) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 18:30:38.132946 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.quota [None req-dd0911d5-6409-4ced-9ad7-e5405ed19dc3 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Getting quotas for user 374555cda1b4424894093ebcc51cd651 and project 116a07f168ef45e1b2f4e7a084fba32c. Resources: {'ram', 'instances', 'cores'} {{(pid=117940) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 18:30:38.150404 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-dd0911d5-6409-4ced-9ad7-e5405ed19dc3 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Going to run 1 instances... {{(pid=117940) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 18:30:38.152655 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-dd0911d5-6409-4ced-9ad7-e5405ed19dc3 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 5c9fbfb9-a377-40af-9553-6670308678cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='636d6d52-5033-47e1-bf75-0b4fc50c0bb0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117940) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 18:30:38.199940 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-dd0911d5-6409-4ced-9ad7-e5405ed19dc3 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.852453 Jun 30 18:30:38.200860 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 156/313] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 30 18:30:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 30 18:30:38.214910 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-3d1c88ce-3986-418f-ad67-9c80380388bc tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:38.215815 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-3d1c88ce-3986-418f-ad67-9c80380388bc tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 5c9fbfb9-a377-40af-9553-6670308678cf] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:38.241572 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-b477f841-b895-478b-a9a6-566595f24f8c tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:38.251460 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-b477f841-b895-478b-a9a6-566595f24f8c tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1362 microversion: 2.1 time: 0.160311 Jun 30 18:30:38.252140 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 158/314] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:38 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:38.271561 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-3d1c88ce-3986-418f-ad67-9c80380388bc tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:38.278287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-3d1c88ce-3986-418f-ad67-9c80380388bc tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf" status: 200 len: 1214 microversion: 2.1 time: 0.067762 Jun 30 18:30:38.278836 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 157/315] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:38 2022] GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:39.097614 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-fe34142e-9400-42fb-a47f-f715484ea8aa tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:39.098709 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-fe34142e-9400-42fb-a47f-f715484ea8aa tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: d6c61f3b-a138-4d3c-971d-8f25d3124178] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:39.105591 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fe34142e-9400-42fb-a47f-f715484ea8aa tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:39.106049 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fe34142e-9400-42fb-a47f-f715484ea8aa tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:39.106827 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fe34142e-9400-42fb-a47f-f715484ea8aa tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:39.107253 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fe34142e-9400-42fb-a47f-f715484ea8aa tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:39.250400 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-fe34142e-9400-42fb-a47f-f715484ea8aa tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:39.258446 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-fe34142e-9400-42fb-a47f-f715484ea8aa tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178" status: 200 len: 1521 microversion: 2.1 time: 0.164661 Jun 30 18:30:39.258918 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 159/316] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:39 2022] GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:39.268731 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-f6b14aef-1839-4d90-853f-cdb38dce0ac8 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:39.269473 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-f6b14aef-1839-4d90-853f-cdb38dce0ac8 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:39.275662 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f6b14aef-1839-4d90-853f-cdb38dce0ac8 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:39.276101 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f6b14aef-1839-4d90-853f-cdb38dce0ac8 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:39.276878 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f6b14aef-1839-4d90-853f-cdb38dce0ac8 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:39.277305 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f6b14aef-1839-4d90-853f-cdb38dce0ac8 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:39.295162 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-0b4c54b5-bc93-4fda-94e8-3515ce575127 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:39.296377 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-0b4c54b5-bc93-4fda-94e8-3515ce575127 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 5c9fbfb9-a377-40af-9553-6670308678cf] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:39.302304 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0b4c54b5-bc93-4fda-94e8-3515ce575127 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:39.302746 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0b4c54b5-bc93-4fda-94e8-3515ce575127 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:39.303502 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0b4c54b5-bc93-4fda-94e8-3515ce575127 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:39.303928 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0b4c54b5-bc93-4fda-94e8-3515ce575127 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:39.372480 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-0b4c54b5-bc93-4fda-94e8-3515ce575127 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:39.380089 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-0b4c54b5-bc93-4fda-94e8-3515ce575127 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf" status: 200 len: 1218 microversion: 2.1 time: 0.088779 Jun 30 18:30:39.380661 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 160/317] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:39 2022] GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:30:39.433297 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-f6b14aef-1839-4d90-853f-cdb38dce0ac8 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:39.441137 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-f6b14aef-1839-4d90-853f-cdb38dce0ac8 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1362 microversion: 2.1 time: 0.176487 Jun 30 18:30:39.441738 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 158/318] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:39 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:40.274577 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-8f68f599-bbaf-445c-ad74-75c514241f6c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:40.275158 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-8f68f599-bbaf-445c-ad74-75c514241f6c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: d6c61f3b-a138-4d3c-971d-8f25d3124178] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:40.282407 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8f68f599-bbaf-445c-ad74-75c514241f6c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:40.282852 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8f68f599-bbaf-445c-ad74-75c514241f6c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:40.283613 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8f68f599-bbaf-445c-ad74-75c514241f6c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:40.284048 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8f68f599-bbaf-445c-ad74-75c514241f6c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:40.396135 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-433ccdee-8587-48ea-9022-a6597b93c241 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:40.396741 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-433ccdee-8587-48ea-9022-a6597b93c241 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 5c9fbfb9-a377-40af-9553-6670308678cf] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:40.402615 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-433ccdee-8587-48ea-9022-a6597b93c241 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:40.403061 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-433ccdee-8587-48ea-9022-a6597b93c241 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:40.403883 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-433ccdee-8587-48ea-9022-a6597b93c241 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:40.404318 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-433ccdee-8587-48ea-9022-a6597b93c241 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:40.422390 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-8f68f599-bbaf-445c-ad74-75c514241f6c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:40.429756 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-8f68f599-bbaf-445c-ad74-75c514241f6c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178" status: 200 len: 1521 microversion: 2.1 time: 0.159052 Jun 30 18:30:40.430327 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 161/319] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:40 2022] GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:40.458547 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-1c50eb72-440a-4848-950a-25c9a5c043b3 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:40.459262 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-1c50eb72-440a-4848-950a-25c9a5c043b3 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:40.465303 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1c50eb72-440a-4848-950a-25c9a5c043b3 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:40.465943 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1c50eb72-440a-4848-950a-25c9a5c043b3 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:40.466732 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1c50eb72-440a-4848-950a-25c9a5c043b3 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:40.467235 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1c50eb72-440a-4848-950a-25c9a5c043b3 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:40.468705 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-433ccdee-8587-48ea-9022-a6597b93c241 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:40.472504 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell1:SELECT=100 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:30:40.476732 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-433ccdee-8587-48ea-9022-a6597b93c241 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf" status: 200 len: 1218 microversion: 2.1 time: 0.084437 Jun 30 18:30:40.477298 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 159/320] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:40 2022] GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:30:40.601286 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-1c50eb72-440a-4848-950a-25c9a5c043b3 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:40.604732 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:30:40.611220 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-1c50eb72-440a-4848-950a-25c9a5c043b3 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1362 microversion: 2.1 time: 0.156481 Jun 30 18:30:40.611794 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 162/321] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:40 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:30:41.449401 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-872b04bb-6d2a-49f0-a3e1-ee25e199673b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:41.450027 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-872b04bb-6d2a-49f0-a3e1-ee25e199673b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: d6c61f3b-a138-4d3c-971d-8f25d3124178] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:41.457239 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-872b04bb-6d2a-49f0-a3e1-ee25e199673b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:41.457717 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-872b04bb-6d2a-49f0-a3e1-ee25e199673b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:41.458545 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-872b04bb-6d2a-49f0-a3e1-ee25e199673b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:41.459012 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-872b04bb-6d2a-49f0-a3e1-ee25e199673b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:41.494573 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-234ac25f-1bab-4bc0-85b7-6df7b86b51ce tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:41.495449 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-234ac25f-1bab-4bc0-85b7-6df7b86b51ce tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 5c9fbfb9-a377-40af-9553-6670308678cf] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:41.504594 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-234ac25f-1bab-4bc0-85b7-6df7b86b51ce tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:41.505503 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-234ac25f-1bab-4bc0-85b7-6df7b86b51ce tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:41.506712 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-234ac25f-1bab-4bc0-85b7-6df7b86b51ce tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:41.507428 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-234ac25f-1bab-4bc0-85b7-6df7b86b51ce tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:41.612799 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-234ac25f-1bab-4bc0-85b7-6df7b86b51ce tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:41.622428 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-234ac25f-1bab-4bc0-85b7-6df7b86b51ce tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf" status: 200 len: 1266 microversion: 2.1 time: 0.132224 Jun 30 18:30:41.624046 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 163/322] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:41 2022] GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf => generated 1266 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:41.630033 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-18605f41-4525-4e34-b361-220da6309dcc tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:41.639876 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-18605f41-4525-4e34-b361-220da6309dcc tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:41.648561 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-872b04bb-6d2a-49f0-a3e1-ee25e199673b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:41.649333 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-18605f41-4525-4e34-b361-220da6309dcc tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:41.649842 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-18605f41-4525-4e34-b361-220da6309dcc tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:41.650618 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-18605f41-4525-4e34-b361-220da6309dcc tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:41.651084 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-18605f41-4525-4e34-b361-220da6309dcc tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:41.658472 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-872b04bb-6d2a-49f0-a3e1-ee25e199673b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178" status: 200 len: 1521 microversion: 2.1 time: 0.212695 Jun 30 18:30:41.659051 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 160/323] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:41 2022] GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:41.791529 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-18605f41-4525-4e34-b361-220da6309dcc tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:41.800705 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-18605f41-4525-4e34-b361-220da6309dcc tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1362 microversion: 2.1 time: 0.174784 Jun 30 18:30:41.805623 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 164/324] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:41 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:42.643609 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-bd9e8585-8ecd-43b5-90ec-7a42b4a6277e tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:42.644978 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-bd9e8585-8ecd-43b5-90ec-7a42b4a6277e tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 5c9fbfb9-a377-40af-9553-6670308678cf] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:42.651385 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-bd9e8585-8ecd-43b5-90ec-7a42b4a6277e tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:42.651930 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-bd9e8585-8ecd-43b5-90ec-7a42b4a6277e tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:42.653547 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-bd9e8585-8ecd-43b5-90ec-7a42b4a6277e tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:42.654099 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-bd9e8585-8ecd-43b5-90ec-7a42b4a6277e tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:42.681101 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-7cbe16dd-cf17-4db8-bbdc-e7fe790567e2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:42.681765 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-7cbe16dd-cf17-4db8-bbdc-e7fe790567e2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: d6c61f3b-a138-4d3c-971d-8f25d3124178] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:42.691817 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7cbe16dd-cf17-4db8-bbdc-e7fe790567e2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:42.692466 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7cbe16dd-cf17-4db8-bbdc-e7fe790567e2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:42.693598 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7cbe16dd-cf17-4db8-bbdc-e7fe790567e2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:42.694215 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7cbe16dd-cf17-4db8-bbdc-e7fe790567e2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:42.872592 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-bd9e8585-8ecd-43b5-90ec-7a42b4a6277e tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:42.883363 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-bd9e8585-8ecd-43b5-90ec-7a42b4a6277e tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf" status: 200 len: 1314 microversion: 2.1 time: 0.246224 Jun 30 18:30:42.884183 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 161/325] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:42 2022] GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:42.890378 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-8117a5ef-f90d-4cb5-b7cb-53d468639c60 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:42.891110 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-8117a5ef-f90d-4cb5-b7cb-53d468639c60 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:42.897534 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8117a5ef-f90d-4cb5-b7cb-53d468639c60 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:42.898277 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8117a5ef-f90d-4cb5-b7cb-53d468639c60 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:42.899247 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8117a5ef-f90d-4cb5-b7cb-53d468639c60 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:42.899683 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8117a5ef-f90d-4cb5-b7cb-53d468639c60 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:42.924051 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-7cbe16dd-cf17-4db8-bbdc-e7fe790567e2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:42.937218 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-7cbe16dd-cf17-4db8-bbdc-e7fe790567e2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178" status: 200 len: 1521 microversion: 2.1 time: 0.260899 Jun 30 18:30:42.938177 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 165/326] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:42 2022] GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:43.055795 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-8117a5ef-f90d-4cb5-b7cb-53d468639c60 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:43.073559 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-8117a5ef-f90d-4cb5-b7cb-53d468639c60 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1362 microversion: 2.1 time: 0.187321 Jun 30 18:30:43.074155 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 162/327] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:42 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:43.405362 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-24fe2823-f774-4468-a12f-278fd2ce621f req-41136289-d327-4dba-8b76-5f70bc9de99f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c9fbfb9-a377-40af-9553-6670308678cf", "tag": "57f39dbb-16f2-45cb-b50d-088f66467896"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:30:43.419749 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-24fe2823-f774-4468-a12f-278fd2ce621f req-41136289-d327-4dba-8b76-5f70bc9de99f service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:43.423341 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-24fe2823-f774-4468-a12f-278fd2ce621f req-41136289-d327-4dba-8b76-5f70bc9de99f service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:43.442775 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.compute.server_external_events [req-24fe2823-f774-4468-a12f-278fd2ce621f req-41136289-d327-4dba-8b76-5f70bc9de99f service nova] Creating event network-changed:57f39dbb-16f2-45cb-b50d-088f66467896 for instance 5c9fbfb9-a377-40af-9553-6670308678cf on hv-cinder-80378 Jun 30 18:30:43.448983 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-24fe2823-f774-4468-a12f-278fd2ce621f req-41136289-d327-4dba-8b76-5f70bc9de99f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050180 Jun 30 18:30:43.449681 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 166/328] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:30:43.900169 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-baf6d031-e6ab-43ba-9a3c-85599d7b4aca tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:43.900751 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-baf6d031-e6ab-43ba-9a3c-85599d7b4aca tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 5c9fbfb9-a377-40af-9553-6670308678cf] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:43.906755 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-baf6d031-e6ab-43ba-9a3c-85599d7b4aca tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:43.907186 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-baf6d031-e6ab-43ba-9a3c-85599d7b4aca tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:43.907930 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-baf6d031-e6ab-43ba-9a3c-85599d7b4aca tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:43.908353 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-baf6d031-e6ab-43ba-9a3c-85599d7b4aca tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:43.955866 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-4080f1f9-7c0f-47a3-86ff-a2d29834eb9c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:43.956688 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-4080f1f9-7c0f-47a3-86ff-a2d29834eb9c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: d6c61f3b-a138-4d3c-971d-8f25d3124178] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:43.963957 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-4080f1f9-7c0f-47a3-86ff-a2d29834eb9c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:43.964406 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-4080f1f9-7c0f-47a3-86ff-a2d29834eb9c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:43.965181 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-4080f1f9-7c0f-47a3-86ff-a2d29834eb9c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:43.965639 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-4080f1f9-7c0f-47a3-86ff-a2d29834eb9c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:44.104718 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-baf6d031-e6ab-43ba-9a3c-85599d7b4aca tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:44.112505 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-baf6d031-e6ab-43ba-9a3c-85599d7b4aca tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf" status: 200 len: 1314 microversion: 2.1 time: 0.216206 Jun 30 18:30:44.113084 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 163/329] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:43 2022] GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:44.117493 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-ec48f5da-b1ba-40ad-a072-e20c3426ffcd tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:44.118313 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-ec48f5da-b1ba-40ad-a072-e20c3426ffcd tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:44.124410 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ec48f5da-b1ba-40ad-a072-e20c3426ffcd tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:44.124859 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ec48f5da-b1ba-40ad-a072-e20c3426ffcd tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:44.125683 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ec48f5da-b1ba-40ad-a072-e20c3426ffcd tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:44.126120 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ec48f5da-b1ba-40ad-a072-e20c3426ffcd tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:44.132603 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-4080f1f9-7c0f-47a3-86ff-a2d29834eb9c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:44.140570 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-4080f1f9-7c0f-47a3-86ff-a2d29834eb9c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178" status: 200 len: 1521 microversion: 2.1 time: 0.189669 Jun 30 18:30:44.141222 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 167/330] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:43 2022] GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:30:44.256787 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-ec48f5da-b1ba-40ad-a072-e20c3426ffcd tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:44.264169 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-ec48f5da-b1ba-40ad-a072-e20c3426ffcd tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1362 microversion: 2.1 time: 0.150092 Jun 30 18:30:44.264740 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 164/331] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:44 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:45.129596 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-eb33bcdd-5ace-416a-8c1d-9be258129508 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:45.130245 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-eb33bcdd-5ace-416a-8c1d-9be258129508 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 5c9fbfb9-a377-40af-9553-6670308678cf] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:45.136652 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-eb33bcdd-5ace-416a-8c1d-9be258129508 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:45.137093 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-eb33bcdd-5ace-416a-8c1d-9be258129508 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:45.137882 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-eb33bcdd-5ace-416a-8c1d-9be258129508 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:45.138313 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-eb33bcdd-5ace-416a-8c1d-9be258129508 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:45.158716 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-08e178a2-afb5-4220-b2b9-7e46625618a0 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:45.159351 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-08e178a2-afb5-4220-b2b9-7e46625618a0 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: d6c61f3b-a138-4d3c-971d-8f25d3124178] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:45.165179 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-08e178a2-afb5-4220-b2b9-7e46625618a0 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:45.165652 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-08e178a2-afb5-4220-b2b9-7e46625618a0 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:45.169143 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-08e178a2-afb5-4220-b2b9-7e46625618a0 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:45.169143 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-08e178a2-afb5-4220-b2b9-7e46625618a0 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:45.338780 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-eb33bcdd-5ace-416a-8c1d-9be258129508 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:45.345685 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-08e178a2-afb5-4220-b2b9-7e46625618a0 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:45.346993 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-eb33bcdd-5ace-416a-8c1d-9be258129508 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf" status: 200 len: 1314 microversion: 2.1 time: 0.221208 Jun 30 18:30:45.347567 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 168/332] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:45 2022] GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:30:45.352368 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-f362beb8-b2ca-41b4-8805-621777d9d96a tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:45.353078 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-f362beb8-b2ca-41b4-8805-621777d9d96a tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:45.354630 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-08e178a2-afb5-4220-b2b9-7e46625618a0 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178" status: 200 len: 1521 microversion: 2.1 time: 0.200335 Jun 30 18:30:45.355413 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 165/333] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:45 2022] GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:45.359749 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f362beb8-b2ca-41b4-8805-621777d9d96a tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:45.360195 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f362beb8-b2ca-41b4-8805-621777d9d96a tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:45.361048 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f362beb8-b2ca-41b4-8805-621777d9d96a tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:45.361477 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f362beb8-b2ca-41b4-8805-621777d9d96a tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:45.506224 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-f362beb8-b2ca-41b4-8805-621777d9d96a tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:45.514037 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-f362beb8-b2ca-41b4-8805-621777d9d96a tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1362 microversion: 2.1 time: 0.165076 Jun 30 18:30:45.515893 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 169/334] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:45 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:46.364505 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-f2e65e6d-9218-4907-981b-81c8f61c198d tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:46.365102 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-f2e65e6d-9218-4907-981b-81c8f61c198d tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 5c9fbfb9-a377-40af-9553-6670308678cf] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:46.371148 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f2e65e6d-9218-4907-981b-81c8f61c198d tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:46.371512 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-0b5f3299-ae3c-448d-8c2c-80903aac9cfe tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:46.371946 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f2e65e6d-9218-4907-981b-81c8f61c198d tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:46.372308 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-0b5f3299-ae3c-448d-8c2c-80903aac9cfe tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: d6c61f3b-a138-4d3c-971d-8f25d3124178] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:46.372423 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f2e65e6d-9218-4907-981b-81c8f61c198d tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:46.372726 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f2e65e6d-9218-4907-981b-81c8f61c198d tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:46.380038 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0b5f3299-ae3c-448d-8c2c-80903aac9cfe tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:46.380603 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0b5f3299-ae3c-448d-8c2c-80903aac9cfe tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:46.381467 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0b5f3299-ae3c-448d-8c2c-80903aac9cfe tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:46.382025 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0b5f3299-ae3c-448d-8c2c-80903aac9cfe tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:46.596450 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-0b5f3299-ae3c-448d-8c2c-80903aac9cfe tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:46.606931 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-0b5f3299-ae3c-448d-8c2c-80903aac9cfe tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178" status: 200 len: 1521 microversion: 2.1 time: 0.239231 Jun 30 18:30:46.611273 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 170/335] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:46 2022] GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178 => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:30:46.614364 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-f2e65e6d-9218-4907-981b-81c8f61c198d tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:46.616457 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-56e1d079-467a-4fd8-bdc8-5722f454f226 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:46.617855 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-56e1d079-467a-4fd8-bdc8-5722f454f226 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:46.624311 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-56e1d079-467a-4fd8-bdc8-5722f454f226 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:46.625070 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-56e1d079-467a-4fd8-bdc8-5722f454f226 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:46.626041 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-56e1d079-467a-4fd8-bdc8-5722f454f226 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:46.626629 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-56e1d079-467a-4fd8-bdc8-5722f454f226 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:46.630187 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-f2e65e6d-9218-4907-981b-81c8f61c198d tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf" status: 200 len: 1314 microversion: 2.1 time: 0.268884 Jun 30 18:30:46.635400 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 166/336] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:46 2022] GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:46.648233 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [req-b3933e79-f162-49e5-bc0a-59cbf94f43f9 req-a5a91be2-aeb5-42bc-852f-15f5638f6a97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e559236-fa0a-4378-b21f-e5f5e669751d", "name": "network-vif-plugged", "status": "completed", "tag": "2523b467-c01d-4854-a427-8bf6153c35b2"}]} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:30:46.663099 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-b3933e79-f162-49e5-bc0a-59cbf94f43f9 req-a5a91be2-aeb5-42bc-852f-15f5638f6a97 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:46.663770 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-b3933e79-f162-49e5-bc0a-59cbf94f43f9 req-a5a91be2-aeb5-42bc-852f-15f5638f6a97 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:46.677684 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.compute.server_external_events [req-b3933e79-f162-49e5-bc0a-59cbf94f43f9 req-a5a91be2-aeb5-42bc-852f-15f5638f6a97 service nova] Creating event network-vif-plugged:2523b467-c01d-4854-a427-8bf6153c35b2 for instance 2e559236-fa0a-4378-b21f-e5f5e669751d on hv-cinder-80378 Jun 30 18:30:46.683672 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [req-b3933e79-f162-49e5-bc0a-59cbf94f43f9 req-a5a91be2-aeb5-42bc-852f-15f5638f6a97 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046714 Jun 30 18:30:46.684284 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 167/337] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:30:46.776695 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-56e1d079-467a-4fd8-bdc8-5722f454f226 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:46.784231 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-56e1d079-467a-4fd8-bdc8-5722f454f226 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1362 microversion: 2.1 time: 0.171778 Jun 30 18:30:46.784994 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 171/338] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:46 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:47.624601 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-ba48a6b2-5870-485e-b716-3e8eba8c2b08 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:47.625296 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-ba48a6b2-5870-485e-b716-3e8eba8c2b08 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: d6c61f3b-a138-4d3c-971d-8f25d3124178] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:47.631401 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ba48a6b2-5870-485e-b716-3e8eba8c2b08 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:47.631843 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ba48a6b2-5870-485e-b716-3e8eba8c2b08 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:47.632587 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ba48a6b2-5870-485e-b716-3e8eba8c2b08 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:47.633016 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ba48a6b2-5870-485e-b716-3e8eba8c2b08 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:47.656950 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-2d6e4a03-d9a3-423b-930d-9cab2d651693 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:47.657771 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-2d6e4a03-d9a3-423b-930d-9cab2d651693 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 5c9fbfb9-a377-40af-9553-6670308678cf] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:47.664523 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2d6e4a03-d9a3-423b-930d-9cab2d651693 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:47.665046 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2d6e4a03-d9a3-423b-930d-9cab2d651693 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:47.665914 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2d6e4a03-d9a3-423b-930d-9cab2d651693 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:47.666435 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2d6e4a03-d9a3-423b-930d-9cab2d651693 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:47.814385 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-ba48a6b2-5870-485e-b716-3e8eba8c2b08 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:47.822172 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-ba48a6b2-5870-485e-b716-3e8eba8c2b08 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178" status: 200 len: 1521 microversion: 2.1 time: 0.202271 Jun 30 18:30:47.822675 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 168/339] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:47 2022] GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:47.827882 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-3fec197c-d230-4b15-b009-39f49924c3e0 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:47.828490 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-3fec197c-d230-4b15-b009-39f49924c3e0 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:47.834257 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3fec197c-d230-4b15-b009-39f49924c3e0 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:47.834706 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3fec197c-d230-4b15-b009-39f49924c3e0 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:47.835463 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3fec197c-d230-4b15-b009-39f49924c3e0 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:47.835896 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3fec197c-d230-4b15-b009-39f49924c3e0 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:47.842303 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-2d6e4a03-d9a3-423b-930d-9cab2d651693 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:47.850416 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-2d6e4a03-d9a3-423b-930d-9cab2d651693 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf" status: 200 len: 1314 microversion: 2.1 time: 0.197900 Jun 30 18:30:47.850987 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 172/340] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:47 2022] GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:47.968491 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-3fec197c-d230-4b15-b009-39f49924c3e0 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:47.975712 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-3fec197c-d230-4b15-b009-39f49924c3e0 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1362 microversion: 2.1 time: 0.152113 Jun 30 18:30:47.976261 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 169/341] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:47 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:48.839424 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-9ed42ae6-da5d-4abe-a131-1c9161980c97 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:48.839934 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-9ed42ae6-da5d-4abe-a131-1c9161980c97 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: d6c61f3b-a138-4d3c-971d-8f25d3124178] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:48.846820 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9ed42ae6-da5d-4abe-a131-1c9161980c97 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:48.847264 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9ed42ae6-da5d-4abe-a131-1c9161980c97 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:48.848103 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9ed42ae6-da5d-4abe-a131-1c9161980c97 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:48.848615 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9ed42ae6-da5d-4abe-a131-1c9161980c97 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:48.868034 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-24fb41ed-94fb-468c-a570-658d4b63e1e0 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:48.868621 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-24fb41ed-94fb-468c-a570-658d4b63e1e0 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 5c9fbfb9-a377-40af-9553-6670308678cf] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:48.870580 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell0:SELECT=2 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:30:48.871366 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell0:SELECT=8 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:30:48.878068 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-24fb41ed-94fb-468c-a570-658d4b63e1e0 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:48.878582 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-24fb41ed-94fb-468c-a570-658d4b63e1e0 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:48.879400 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-24fb41ed-94fb-468c-a570-658d4b63e1e0 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:48.879868 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-24fb41ed-94fb-468c-a570-658d4b63e1e0 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:49.074157 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-9ed42ae6-da5d-4abe-a131-1c9161980c97 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:49.074444 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-24fb41ed-94fb-468c-a570-658d4b63e1e0 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:49.074545 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-9ed42ae6-da5d-4abe-a131-1c9161980c97 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178" status: 200 len: 1521 microversion: 2.1 time: 0.237895 Jun 30 18:30:49.074623 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 173/342] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:48 2022] GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:49.079566 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-8529a141-e8ae-42e0-8223-89ad3e26423c tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:49.080182 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-8529a141-e8ae-42e0-8223-89ad3e26423c tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:49.086485 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8529a141-e8ae-42e0-8223-89ad3e26423c tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:49.086939 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8529a141-e8ae-42e0-8223-89ad3e26423c tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:49.087708 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8529a141-e8ae-42e0-8223-89ad3e26423c tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:49.088309 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-24fb41ed-94fb-468c-a570-658d4b63e1e0 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf" status: 200 len: 1314 microversion: 2.1 time: 0.224129 Jun 30 18:30:49.088621 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8529a141-e8ae-42e0-8223-89ad3e26423c tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:49.088877 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 170/343] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:48 2022] GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:30:49.225662 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-8529a141-e8ae-42e0-8223-89ad3e26423c tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:49.233097 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-8529a141-e8ae-42e0-8223-89ad3e26423c tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1362 microversion: 2.1 time: 0.157516 Jun 30 18:30:49.235824 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 174/344] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:49 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:50.091231 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-8633a4d2-7cad-49ff-84dc-89bfbb54d946 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:50.091841 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-8633a4d2-7cad-49ff-84dc-89bfbb54d946 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: d6c61f3b-a138-4d3c-971d-8f25d3124178] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:50.098492 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8633a4d2-7cad-49ff-84dc-89bfbb54d946 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:50.098942 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8633a4d2-7cad-49ff-84dc-89bfbb54d946 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:50.099696 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8633a4d2-7cad-49ff-84dc-89bfbb54d946 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:50.100136 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8633a4d2-7cad-49ff-84dc-89bfbb54d946 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:50.105351 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-028d34e7-fd8f-4b33-b88d-a1248b741364 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:50.106003 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-028d34e7-fd8f-4b33-b88d-a1248b741364 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 5c9fbfb9-a377-40af-9553-6670308678cf] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:50.113775 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-028d34e7-fd8f-4b33-b88d-a1248b741364 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:50.114218 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-028d34e7-fd8f-4b33-b88d-a1248b741364 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:50.114972 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-028d34e7-fd8f-4b33-b88d-a1248b741364 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:50.115402 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-028d34e7-fd8f-4b33-b88d-a1248b741364 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:50.289319 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-8633a4d2-7cad-49ff-84dc-89bfbb54d946 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:50.307404 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-8633a4d2-7cad-49ff-84dc-89bfbb54d946 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178" status: 200 len: 1521 microversion: 2.1 time: 0.218941 Jun 30 18:30:50.309241 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 171/345] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:50 2022] GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:50.315240 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-3fc44fd0-5793-400d-a51b-2238af3e1781 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:50.315925 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-3fc44fd0-5793-400d-a51b-2238af3e1781 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:50.319554 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-028d34e7-fd8f-4b33-b88d-a1248b741364 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:50.322178 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3fc44fd0-5793-400d-a51b-2238af3e1781 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:50.322680 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3fc44fd0-5793-400d-a51b-2238af3e1781 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:50.323444 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3fc44fd0-5793-400d-a51b-2238af3e1781 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:50.323872 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3fc44fd0-5793-400d-a51b-2238af3e1781 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:50.328082 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-028d34e7-fd8f-4b33-b88d-a1248b741364 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf" status: 200 len: 1314 microversion: 2.1 time: 0.226528 Jun 30 18:30:50.328409 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 175/346] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:50 2022] GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:30:50.452614 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-3fc44fd0-5793-400d-a51b-2238af3e1781 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:50.459999 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-3fc44fd0-5793-400d-a51b-2238af3e1781 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1362 microversion: 2.1 time: 0.149707 Jun 30 18:30:50.460564 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 172/347] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:50 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:51.326972 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-bfa1348c-2520-46af-b9cc-62db7fd9740e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:51.327566 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-bfa1348c-2520-46af-b9cc-62db7fd9740e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: d6c61f3b-a138-4d3c-971d-8f25d3124178] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:51.333965 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-bfa1348c-2520-46af-b9cc-62db7fd9740e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:51.334430 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-bfa1348c-2520-46af-b9cc-62db7fd9740e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:51.335171 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-bfa1348c-2520-46af-b9cc-62db7fd9740e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:51.335596 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-bfa1348c-2520-46af-b9cc-62db7fd9740e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:51.344934 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-30720e0f-f659-4e41-b5e2-bda0dd87bbfb tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:51.345513 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-30720e0f-f659-4e41-b5e2-bda0dd87bbfb tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 5c9fbfb9-a377-40af-9553-6670308678cf] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:51.351490 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-30720e0f-f659-4e41-b5e2-bda0dd87bbfb tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:51.351937 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-30720e0f-f659-4e41-b5e2-bda0dd87bbfb tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:51.352693 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-30720e0f-f659-4e41-b5e2-bda0dd87bbfb tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:51.353117 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-30720e0f-f659-4e41-b5e2-bda0dd87bbfb tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:51.547705 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-bfa1348c-2520-46af-b9cc-62db7fd9740e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:51.550978 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-30720e0f-f659-4e41-b5e2-bda0dd87bbfb tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:51.556231 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-bfa1348c-2520-46af-b9cc-62db7fd9740e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178" status: 200 len: 1521 microversion: 2.1 time: 0.233021 Jun 30 18:30:51.558108 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 176/348] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:51 2022] GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:51.559973 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-30720e0f-f659-4e41-b5e2-bda0dd87bbfb tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf" status: 200 len: 1314 microversion: 2.1 time: 0.219471 Jun 30 18:30:51.560716 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 173/349] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:51 2022] GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:30:51.569929 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-3c8f9407-b227-4173-9f03-7ac3a8ffa05e tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:51.569929 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-3c8f9407-b227-4173-9f03-7ac3a8ffa05e tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:51.569929 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_api:SELECT=66 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:30:51.571325 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3c8f9407-b227-4173-9f03-7ac3a8ffa05e tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:51.571777 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3c8f9407-b227-4173-9f03-7ac3a8ffa05e tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:51.572842 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3c8f9407-b227-4173-9f03-7ac3a8ffa05e tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:51.573472 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3c8f9407-b227-4173-9f03-7ac3a8ffa05e tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:51.669431 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [req-40812379-3a88-4499-9ddd-b3effef528f2 req-53b142f5-d0e3-4bb8-9928-d364e5dce330 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c9fbfb9-a377-40af-9553-6670308678cf", "name": "network-vif-plugged", "status": "completed", "tag": "57f39dbb-16f2-45cb-b50d-088f66467896"}]} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:30:51.680092 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-40812379-3a88-4499-9ddd-b3effef528f2 req-53b142f5-d0e3-4bb8-9928-d364e5dce330 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:51.680800 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-40812379-3a88-4499-9ddd-b3effef528f2 req-53b142f5-d0e3-4bb8-9928-d364e5dce330 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:51.694985 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.compute.server_external_events [req-40812379-3a88-4499-9ddd-b3effef528f2 req-53b142f5-d0e3-4bb8-9928-d364e5dce330 service nova] Creating event network-vif-plugged:57f39dbb-16f2-45cb-b50d-088f66467896 for instance 5c9fbfb9-a377-40af-9553-6670308678cf on hv-cinder-80378 Jun 30 18:30:51.701573 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [req-40812379-3a88-4499-9ddd-b3effef528f2 req-53b142f5-d0e3-4bb8-9928-d364e5dce330 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035794 Jun 30 18:30:51.705156 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 174/350] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:30:51.737726 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-3c8f9407-b227-4173-9f03-7ac3a8ffa05e tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:51.745628 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-3c8f9407-b227-4173-9f03-7ac3a8ffa05e tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1362 microversion: 2.1 time: 0.186443 Jun 30 18:30:51.746559 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 177/351] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:51 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:52.575986 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-b43f18bf-fcff-4964-aa80-f574bfcd6a8d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:52.577016 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-b43f18bf-fcff-4964-aa80-f574bfcd6a8d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: d6c61f3b-a138-4d3c-971d-8f25d3124178] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:52.577136 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-4dea8426-9177-4fd3-9cdc-b77cbfabe2b9 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:52.579425 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-4dea8426-9177-4fd3-9cdc-b77cbfabe2b9 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 5c9fbfb9-a377-40af-9553-6670308678cf] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:52.584129 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b43f18bf-fcff-4964-aa80-f574bfcd6a8d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:52.584855 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b43f18bf-fcff-4964-aa80-f574bfcd6a8d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:52.585884 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b43f18bf-fcff-4964-aa80-f574bfcd6a8d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:52.586393 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-4dea8426-9177-4fd3-9cdc-b77cbfabe2b9 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:52.586532 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b43f18bf-fcff-4964-aa80-f574bfcd6a8d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:52.586897 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-4dea8426-9177-4fd3-9cdc-b77cbfabe2b9 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:52.587846 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-4dea8426-9177-4fd3-9cdc-b77cbfabe2b9 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:52.588279 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-4dea8426-9177-4fd3-9cdc-b77cbfabe2b9 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:52.788321 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-b43f18bf-fcff-4964-aa80-f574bfcd6a8d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:52.798990 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-b43f18bf-fcff-4964-aa80-f574bfcd6a8d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178" status: 200 len: 1521 microversion: 2.1 time: 0.227639 Jun 30 18:30:52.799583 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 175/352] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:52 2022] GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178 => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:52.801144 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-4dea8426-9177-4fd3-9cdc-b77cbfabe2b9 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:52.806161 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-51aa88f0-8739-49d2-b840-1a82a356ed23 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:52.806963 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-51aa88f0-8739-49d2-b840-1a82a356ed23 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:52.812226 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-4dea8426-9177-4fd3-9cdc-b77cbfabe2b9 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf" status: 200 len: 1314 microversion: 2.1 time: 0.238170 Jun 30 18:30:52.812962 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 178/353] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:52 2022] GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:30:52.817258 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-51aa88f0-8739-49d2-b840-1a82a356ed23 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:52.817854 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-51aa88f0-8739-49d2-b840-1a82a356ed23 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:52.818501 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-51aa88f0-8739-49d2-b840-1a82a356ed23 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:52.818941 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-51aa88f0-8739-49d2-b840-1a82a356ed23 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:52.963749 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-51aa88f0-8739-49d2-b840-1a82a356ed23 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:52.971284 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-51aa88f0-8739-49d2-b840-1a82a356ed23 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1362 microversion: 2.1 time: 0.170591 Jun 30 18:30:52.971837 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 176/354] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:52 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:53.818108 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-3feba6b7-f30d-40c5-aeca-09096d8cfcd7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:53.819418 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-3feba6b7-f30d-40c5-aeca-09096d8cfcd7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: d6c61f3b-a138-4d3c-971d-8f25d3124178] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:53.831697 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-074eb847-a395-4036-acee-ef5dd0a919b7 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:53.833104 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-074eb847-a395-4036-acee-ef5dd0a919b7 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 5c9fbfb9-a377-40af-9553-6670308678cf] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:53.841257 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-074eb847-a395-4036-acee-ef5dd0a919b7 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:53.844853 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3feba6b7-f30d-40c5-aeca-09096d8cfcd7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:53.845301 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3feba6b7-f30d-40c5-aeca-09096d8cfcd7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:53.846175 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-074eb847-a395-4036-acee-ef5dd0a919b7 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:53.847651 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3feba6b7-f30d-40c5-aeca-09096d8cfcd7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:53.848089 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3feba6b7-f30d-40c5-aeca-09096d8cfcd7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:53.853092 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-074eb847-a395-4036-acee-ef5dd0a919b7 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:53.853920 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-074eb847-a395-4036-acee-ef5dd0a919b7 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:54.091511 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-3feba6b7-f30d-40c5-aeca-09096d8cfcd7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:54.103555 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-3feba6b7-f30d-40c5-aeca-09096d8cfcd7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178" status: 200 len: 1521 microversion: 2.1 time: 0.289480 Jun 30 18:30:54.104146 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 179/355] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:53 2022] GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178 => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:54.106535 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-074eb847-a395-4036-acee-ef5dd0a919b7 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:54.109426 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-dcf217d0-c880-49c1-b0d0-98dda73880c0 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:54.110848 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-dcf217d0-c880-49c1-b0d0-98dda73880c0 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:54.115249 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell1:SELECT=100 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:30:54.119603 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-dcf217d0-c880-49c1-b0d0-98dda73880c0 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:54.120024 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-074eb847-a395-4036-acee-ef5dd0a919b7 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf" status: 200 len: 1314 microversion: 2.1 time: 0.293294 Jun 30 18:30:54.120133 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-dcf217d0-c880-49c1-b0d0-98dda73880c0 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:54.120824 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 177/356] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:53 2022] GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:54.121016 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-dcf217d0-c880-49c1-b0d0-98dda73880c0 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:54.122002 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-dcf217d0-c880-49c1-b0d0-98dda73880c0 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:54.145974 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell1:SELECT=100 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:30:54.285700 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-dcf217d0-c880-49c1-b0d0-98dda73880c0 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:54.293236 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-dcf217d0-c880-49c1-b0d0-98dda73880c0 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1549 microversion: 2.1 time: 0.187920 Jun 30 18:30:54.293867 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 180/357] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:54 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1549 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:54.310406 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-384c342c-075d-47cd-8b5b-73d77773e740 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:54.311009 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-384c342c-075d-47cd-8b5b-73d77773e740 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:54.317910 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-384c342c-075d-47cd-8b5b-73d77773e740 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:54.318359 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-384c342c-075d-47cd-8b5b-73d77773e740 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:54.319118 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-384c342c-075d-47cd-8b5b-73d77773e740 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:54.319554 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-384c342c-075d-47cd-8b5b-73d77773e740 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:54.412536 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-384c342c-075d-47cd-8b5b-73d77773e740 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.106114 Jun 30 18:30:54.413204 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 178/358] 10.222.0.33 () {58 vars in 1274 bytes} [Thu Jun 30 18:30:54 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:30:55.120516 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-d725cc05-2885-4395-b160-4fd9cb014b1c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:55.121253 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-d725cc05-2885-4395-b160-4fd9cb014b1c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: d6c61f3b-a138-4d3c-971d-8f25d3124178] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:55.127967 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d725cc05-2885-4395-b160-4fd9cb014b1c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:55.128410 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d725cc05-2885-4395-b160-4fd9cb014b1c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:55.129171 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d725cc05-2885-4395-b160-4fd9cb014b1c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:55.129630 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d725cc05-2885-4395-b160-4fd9cb014b1c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:55.139026 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-9cd10af5-55ad-460e-b58e-0280c85d4cce tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:55.144510 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-9cd10af5-55ad-460e-b58e-0280c85d4cce tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 5c9fbfb9-a377-40af-9553-6670308678cf] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:55.153769 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9cd10af5-55ad-460e-b58e-0280c85d4cce tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:55.156096 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9cd10af5-55ad-460e-b58e-0280c85d4cce tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:55.157646 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9cd10af5-55ad-460e-b58e-0280c85d4cce tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:55.164723 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9cd10af5-55ad-460e-b58e-0280c85d4cce tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:55.555118 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-d725cc05-2885-4395-b160-4fd9cb014b1c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:55.562759 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-d725cc05-2885-4395-b160-4fd9cb014b1c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178" status: 200 len: 1521 microversion: 2.1 time: 0.446070 Jun 30 18:30:55.563330 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 181/359] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:55 2022] GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178 => generated 1521 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:55.574269 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-9cd10af5-55ad-460e-b58e-0280c85d4cce tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:55.583300 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-9cd10af5-55ad-460e-b58e-0280c85d4cce tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf" status: 200 len: 1314 microversion: 2.1 time: 0.449555 Jun 30 18:30:55.584083 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 179/360] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:55 2022] GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf => generated 1314 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:30:55.966840 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-0d950b02-bfee-43ba-b08c-352f579733c7 req-ef407327-8cc7-4a86-b00f-b66c40369375 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e559236-fa0a-4378-b21f-e5f5e669751d", "tag": "2523b467-c01d-4854-a427-8bf6153c35b2"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:30:55.975316 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-0d950b02-bfee-43ba-b08c-352f579733c7 req-ef407327-8cc7-4a86-b00f-b66c40369375 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:55.975952 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-0d950b02-bfee-43ba-b08c-352f579733c7 req-ef407327-8cc7-4a86-b00f-b66c40369375 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:55.987333 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.compute.server_external_events [req-0d950b02-bfee-43ba-b08c-352f579733c7 req-ef407327-8cc7-4a86-b00f-b66c40369375 service nova] Creating event network-changed:2523b467-c01d-4854-a427-8bf6153c35b2 for instance 2e559236-fa0a-4378-b21f-e5f5e669751d on hv-cinder-80378 Jun 30 18:30:55.992474 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-0d950b02-bfee-43ba-b08c-352f579733c7 req-ef407327-8cc7-4a86-b00f-b66c40369375 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029340 Jun 30 18:30:55.993139 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 182/361] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:30:56.048942 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-6773e21b-0066-4809-951f-a4956debdc23 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d0174370-cc71-4587-ae8d-bde2b2dedec6", "device": "/dev/sdb"}} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:30:56.050608 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-6773e21b-0066-4809-951f-a4956debdc23 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: dac8aacd-66be-4695-a513-af3d837d9d47] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:56.056996 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6773e21b-0066-4809-951f-a4956debdc23 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:56.057442 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6773e21b-0066-4809-951f-a4956debdc23 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:56.058224 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6773e21b-0066-4809-951f-a4956debdc23 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:56.058652 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6773e21b-0066-4809-951f-a4956debdc23 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:56.584467 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-eb2acd6b-c9a6-44c1-9917-8ad7d69408cd tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:56.591086 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-eb2acd6b-c9a6-44c1-9917-8ad7d69408cd tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: d6c61f3b-a138-4d3c-971d-8f25d3124178] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:56.600030 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-eb2acd6b-c9a6-44c1-9917-8ad7d69408cd tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:56.601874 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-eb2acd6b-c9a6-44c1-9917-8ad7d69408cd tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:56.602690 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-eb2acd6b-c9a6-44c1-9917-8ad7d69408cd tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:56.603191 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-eb2acd6b-c9a6-44c1-9917-8ad7d69408cd tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:56.743319 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-eb2acd6b-c9a6-44c1-9917-8ad7d69408cd tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:56.750714 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-eb2acd6b-c9a6-44c1-9917-8ad7d69408cd tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178" status: 200 len: 1521 microversion: 2.1 time: 0.171034 Jun 30 18:30:56.751286 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 183/362] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:56 2022] GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:56.755760 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-e3977238-1529-4f74-bfb4-3a37c18d4e46 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:56.756353 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-e3977238-1529-4f74-bfb4-3a37c18d4e46 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 5c9fbfb9-a377-40af-9553-6670308678cf] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:56.762827 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e3977238-1529-4f74-bfb4-3a37c18d4e46 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:56.763277 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e3977238-1529-4f74-bfb4-3a37c18d4e46 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:56.764045 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e3977238-1529-4f74-bfb4-3a37c18d4e46 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:56.764667 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e3977238-1529-4f74-bfb4-3a37c18d4e46 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:56.903068 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-e3977238-1529-4f74-bfb4-3a37c18d4e46 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:56.912522 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-e3977238-1529-4f74-bfb4-3a37c18d4e46 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf" status: 200 len: 1314 microversion: 2.1 time: 0.160175 Jun 30 18:30:56.913119 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 184/363] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:56 2022] GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:57.768522 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-0723b39f-b2e2-4b07-934a-0660567dc709 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:57.770048 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-0723b39f-b2e2-4b07-934a-0660567dc709 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: d6c61f3b-a138-4d3c-971d-8f25d3124178] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:57.781068 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0723b39f-b2e2-4b07-934a-0660567dc709 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:57.781550 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0723b39f-b2e2-4b07-934a-0660567dc709 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:57.782365 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0723b39f-b2e2-4b07-934a-0660567dc709 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:57.782798 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0723b39f-b2e2-4b07-934a-0660567dc709 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:58.004490 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-0723b39f-b2e2-4b07-934a-0660567dc709 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:58.013117 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-0723b39f-b2e2-4b07-934a-0660567dc709 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178" status: 200 len: 1521 microversion: 2.1 time: 0.249023 Jun 30 18:30:58.013911 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 185/364] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:57 2022] GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:30:58.019903 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-041eb0ff-f150-47e1-bc12-d6194e32c0df tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:58.020899 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-041eb0ff-f150-47e1-bc12-d6194e32c0df tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 5c9fbfb9-a377-40af-9553-6670308678cf] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:58.028061 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-041eb0ff-f150-47e1-bc12-d6194e32c0df tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:58.030852 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-041eb0ff-f150-47e1-bc12-d6194e32c0df tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:58.031790 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-041eb0ff-f150-47e1-bc12-d6194e32c0df tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:58.032229 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-041eb0ff-f150-47e1-bc12-d6194e32c0df tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:58.048650 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-6773e21b-0066-4809-951f-a4956debdc23 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "POST /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.003340 Jun 30 18:30:58.054651 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 180/365] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 30 18:30:56 2022] POST /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47/os-volume_attachments => generated 194 bytes in 2010 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:30:58.328657 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-041eb0ff-f150-47e1-bc12-d6194e32c0df tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:58.351303 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-041eb0ff-f150-47e1-bc12-d6194e32c0df tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf" status: 200 len: 1499 microversion: 2.1 time: 0.325516 Jun 30 18:30:58.352035 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 186/366] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:58 2022] GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf => generated 1499 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:59.036788 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-c71f81af-b7be-42b0-acda-4a14719b725b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:59.037593 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-c71f81af-b7be-42b0-acda-4a14719b725b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: d6c61f3b-a138-4d3c-971d-8f25d3124178] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:59.044493 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c71f81af-b7be-42b0-acda-4a14719b725b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:59.044788 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c71f81af-b7be-42b0-acda-4a14719b725b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:59.045675 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c71f81af-b7be-42b0-acda-4a14719b725b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:59.046773 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c71f81af-b7be-42b0-acda-4a14719b725b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:59.188741 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-fd1db9a0-2fbf-4bf9-86f6-48542ae6030c tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:59.190052 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-fd1db9a0-2fbf-4bf9-86f6-48542ae6030c tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 5c9fbfb9-a377-40af-9553-6670308678cf] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:59.196810 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fd1db9a0-2fbf-4bf9-86f6-48542ae6030c tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:59.197259 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fd1db9a0-2fbf-4bf9-86f6-48542ae6030c tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:59.198290 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fd1db9a0-2fbf-4bf9-86f6-48542ae6030c tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:59.198906 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fd1db9a0-2fbf-4bf9-86f6-48542ae6030c tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:59.228510 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-fd1db9a0-2fbf-4bf9-86f6-48542ae6030c tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 5c9fbfb9-a377-40af-9553-6670308678cf] Going to try to terminate instance {{(pid=117941) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 18:30:59.325319 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-fd1db9a0-2fbf-4bf9-86f6-48542ae6030c tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf" status: 204 len: 0 microversion: 2.1 time: 0.140818 Jun 30 18:30:59.326233 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 187/367] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 30 18:30:59 2022] DELETE /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 18:30:59.334979 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-1e86d9fa-76f9-4ede-ab84-e99b4f46f994 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:59.335671 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-1e86d9fa-76f9-4ede-ab84-e99b4f46f994 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 5c9fbfb9-a377-40af-9553-6670308678cf] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:59.341893 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1e86d9fa-76f9-4ede-ab84-e99b4f46f994 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:59.342338 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1e86d9fa-76f9-4ede-ab84-e99b4f46f994 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:59.343155 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1e86d9fa-76f9-4ede-ab84-e99b4f46f994 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:59.343583 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1e86d9fa-76f9-4ede-ab84-e99b4f46f994 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:59.356746 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-c71f81af-b7be-42b0-acda-4a14719b725b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:59.365232 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-c71f81af-b7be-42b0-acda-4a14719b725b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178" status: 200 len: 1501 microversion: 2.1 time: 0.336725 Jun 30 18:30:59.365853 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 181/368] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:59 2022] GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178 => generated 1501 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:59.382488 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-5eb37ac9-08c9-4da0-809f-18db3b46c61f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8e4b0825-f8fe-4207-b8e2-388aac212d3f"}} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:30:59.383635 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-5eb37ac9-08c9-4da0-809f-18db3b46c61f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: d6c61f3b-a138-4d3c-971d-8f25d3124178] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:59.389692 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5eb37ac9-08c9-4da0-809f-18db3b46c61f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:59.390142 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5eb37ac9-08c9-4da0-809f-18db3b46c61f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:59.391117 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5eb37ac9-08c9-4da0-809f-18db3b46c61f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:59.391555 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5eb37ac9-08c9-4da0-809f-18db3b46c61f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:59.428572 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.wsgi [None req-5eb37ac9-08c9-4da0-809f-18db3b46c61f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] HTTP exception thrown: Cannot 'attach_volume' instance d6c61f3b-a138-4d3c-971d-8f25d3124178 while it is in vm_state rescued Jun 30 18:30:59.430287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-5eb37ac9-08c9-4da0-809f-18db3b46c61f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Request method failure captured: Jun 30 18:30:59.430287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: request: POST /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178/os-volume_attachments HTTP/1.1 Jun 30 18:30:59.430287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept: application/json Jun 30 18:30:59.430287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept-Encoding: identity Jun 30 18:30:59.430287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Connection: close Jun 30 18:30:59.430287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Length: 74 Jun 30 18:30:59.430287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Type: application/json Jun 30 18:30:59.430287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Host: 10.222.0.33 Jun 30 18:30:59.430287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Openstack-System-Scope: None Jun 30 18:30:59.430287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: User-Agent: python-urllib3/1.26.9 Jun 30 18:30:59.430287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Auth-Token: gAAAAABivetPoBJVuK1_waLHBdUgEdOXaEr_7pepJLshTowu0y0zEtLsiCOVgrIZcKArCDbekbtcpzpEH-S3F9_gKy-yucVrKZ3vxF5Hhm7_TRqirclJF8mG1hvbjhTpmtvTiqYsOVgnx89AOW01E7ENmFhWdbFyZjBHC046c8-hCFkVolZmamg Jun 30 18:30:59.430287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Id: None Jun 30 18:30:59.430287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Name: None Jun 30 18:30:59.430287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Identity-Status: Confirmed Jun 30 18:30:59.430287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Is-Admin-Project: True Jun 30 18:30:59.430287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Id: default Jun 30 18:30:59.430287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Name: Default Jun 30 18:30:59.430287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Id: 89156f1867314be89e5108d5506b83a3 Jun 30 18:30:59.430287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-785753659 Jun 30 18:30:59.430287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Role: reader,member Jun 30 18:30:59.430287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Roles: reader,member Jun 30 18:30:59.431872 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89156f1867314be89e5108d5506b83a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_89156f1867314be89e5108d5506b83a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/89156f1867314be89e5108d5506b83a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89156f1867314be89e5108d5506b83a3"}]}] Jun 30 18:30:59.431872 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant: tempest-ServerRescueNegativeTestJSON-785753659 Jun 30 18:30:59.431872 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Id: 89156f1867314be89e5108d5506b83a3 Jun 30 18:30:59.431872 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-785753659 Jun 30 18:30:59.431872 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User: tempest-ServerRescueNegativeTestJSON-785753659-project Jun 30 18:30:59.431872 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Id: default Jun 30 18:30:59.431872 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Name: Default Jun 30 18:30:59.431872 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Id: c66efdb1cc27467d85831617590c8b28 Jun 30 18:30:59.431872 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Name: tempest-ServerRescueNegativeTestJSON-785753659-project Jun 30 18:30:59.431872 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Jun 30 18:30:59.431872 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: {"volumeAttachment": {"volumeId": "8e4b0825-f8fe-4207-b8e2-388aac212d3f"}} Jun 30 18:30:59.431872 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: method: > Jun 30 18:30:59.432765 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: exception: Cannot 'attach_volume' instance d6c61f3b-a138-4d3c-971d-8f25d3124178 while it is in vm_state rescued Jun 30 18:30:59.432765 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: action_args: {'server_id': 'd6c61f3b-a138-4d3c-971d-8f25d3124178', 'body': {'volumeAttachment': {'volumeId': '8e4b0825-f8fe-4207-b8e2-388aac212d3f'}}} Jun 30 18:30:59.432765 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:30:59.432765 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:30:59.432765 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 30 18:30:59.432765 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 30 18:30:59.432765 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 30 18:30:59.432765 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 30 18:30:59.432765 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 30 18:30:59.432765 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 30 18:30:59.432765 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d6c61f3b-a138-4d3c-971d-8f25d3124178 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 30 18:30:59.432765 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:30:59.432765 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:30:59.432765 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:30:59.432765 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:30:59.432765 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:30:59.432765 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:30:59.432765 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:30:59.432765 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:30:59.433958 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:30:59.433958 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:30:59.433958 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 18:30:59.433958 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 18:30:59.433958 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 18:30:59.433958 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 18:30:59.433958 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 18:30:59.433958 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 18:30:59.433958 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 30 18:30:59.433958 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 30 18:30:59.433958 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 30 18:30:59.433958 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 30 18:30:59.433958 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance d6c61f3b-a138-4d3c-971d-8f25d3124178 while it is in vm_state rescued Jun 30 18:30:59.433958 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:30:59.433958 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:30:59.433958 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:30:59.433958 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:30:59.433958 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:30:59.433958 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:30:59.435063 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:30:59.435063 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:30:59.435063 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance d6c61f3b-a138-4d3c-971d-8f25d3124178 while it is in vm_state rescued Jun 30 18:30:59.435063 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:30:59.435063 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-5eb37ac9-08c9-4da0-809f-18db3b46c61f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Returning 409 to user: Cannot 'attach_volume' instance d6c61f3b-a138-4d3c-971d-8f25d3124178 while it is in vm_state rescued {{(pid=117940) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:30:59.435063 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-5eb37ac9-08c9-4da0-809f-18db3b46c61f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "POST /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.053076 Jun 30 18:30:59.435063 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 182/369] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 30 18:30:59 2022] POST /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178/os-volume_attachments => generated 152 bytes in 54 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 30 18:30:59.442965 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-082147d5-652b-4412-aeee-3b343d244ed1 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:30:59.444454 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-082147d5-652b-4412-aeee-3b343d244ed1 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: d6c61f3b-a138-4d3c-971d-8f25d3124178] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:59.453512 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-082147d5-652b-4412-aeee-3b343d244ed1 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:59.453984 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-082147d5-652b-4412-aeee-3b343d244ed1 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:59.454738 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-082147d5-652b-4412-aeee-3b343d244ed1 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:59.455162 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-082147d5-652b-4412-aeee-3b343d244ed1 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:59.480298 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-1e86d9fa-76f9-4ede-ab84-e99b4f46f994 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:59.488445 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-1e86d9fa-76f9-4ede-ab84-e99b4f46f994 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf" status: 200 len: 1505 microversion: 2.1 time: 0.157547 Jun 30 18:30:59.489048 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 188/370] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:59 2022] GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:30:59.522572 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-082147d5-652b-4412-aeee-3b343d244ed1 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "POST /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178/action" status: 202 len: 0 microversion: 2.1 time: 0.083675 Jun 30 18:30:59.523189 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 183/371] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 30 18:30:59 2022] POST /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 18:30:59.531807 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-a15d2a14-41a4-4e99-a3b1-689b0da48a23 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:59.532402 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-a15d2a14-41a4-4e99-a3b1-689b0da48a23 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: d6c61f3b-a138-4d3c-971d-8f25d3124178] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:59.538723 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a15d2a14-41a4-4e99-a3b1-689b0da48a23 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:59.539104 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a15d2a14-41a4-4e99-a3b1-689b0da48a23 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:59.539840 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a15d2a14-41a4-4e99-a3b1-689b0da48a23 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:59.540265 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a15d2a14-41a4-4e99-a3b1-689b0da48a23 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:59.669642 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-a15d2a14-41a4-4e99-a3b1-689b0da48a23 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:59.677037 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-a15d2a14-41a4-4e99-a3b1-689b0da48a23 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178" status: 200 len: 1509 microversion: 2.1 time: 0.149580 Jun 30 18:30:59.677621 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 189/372] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:59 2022] GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178 => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:00.507038 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-ebb8b55a-b19f-4b1d-8242-4325aef88396 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:00.507656 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-ebb8b55a-b19f-4b1d-8242-4325aef88396 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 5c9fbfb9-a377-40af-9553-6670308678cf] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:00.514652 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ebb8b55a-b19f-4b1d-8242-4325aef88396 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:00.515105 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ebb8b55a-b19f-4b1d-8242-4325aef88396 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:00.515908 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ebb8b55a-b19f-4b1d-8242-4325aef88396 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:00.516343 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ebb8b55a-b19f-4b1d-8242-4325aef88396 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:00.696391 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-65ab03ed-db9b-4637-8d4e-76753e6da7e9 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:00.696391 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-65ab03ed-db9b-4637-8d4e-76753e6da7e9 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: d6c61f3b-a138-4d3c-971d-8f25d3124178] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:00.703506 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-65ab03ed-db9b-4637-8d4e-76753e6da7e9 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:00.703947 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-65ab03ed-db9b-4637-8d4e-76753e6da7e9 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:00.704699 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-65ab03ed-db9b-4637-8d4e-76753e6da7e9 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:00.705121 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-65ab03ed-db9b-4637-8d4e-76753e6da7e9 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:00.732247 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-ebb8b55a-b19f-4b1d-8242-4325aef88396 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:00.740770 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-ebb8b55a-b19f-4b1d-8242-4325aef88396 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf" status: 200 len: 1505 microversion: 2.1 time: 0.238422 Jun 30 18:31:00.741357 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 184/373] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:00 2022] GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf => generated 1505 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:00.886395 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-65ab03ed-db9b-4637-8d4e-76753e6da7e9 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:00.893724 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-65ab03ed-db9b-4637-8d4e-76753e6da7e9 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178" status: 200 len: 1509 microversion: 2.1 time: 0.202039 Jun 30 18:31:00.894287 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 190/374] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:00 2022] GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178 => generated 1509 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:31:01.759618 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-f92689ce-b228-403b-be70-05046cda94db tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:01.760429 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-f92689ce-b228-403b-be70-05046cda94db tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 5c9fbfb9-a377-40af-9553-6670308678cf] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:01.767733 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f92689ce-b228-403b-be70-05046cda94db tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:01.768188 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f92689ce-b228-403b-be70-05046cda94db tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:01.768958 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f92689ce-b228-403b-be70-05046cda94db tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:01.769392 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f92689ce-b228-403b-be70-05046cda94db tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:01.801424 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-5e5154c6-f354-4e72-9fb7-c0e3c7c76303 req-fc8f5b83-890a-4fac-90cb-23e0adda17b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c9fbfb9-a377-40af-9553-6670308678cf", "name": "network-vif-deleted", "tag": "57f39dbb-16f2-45cb-b50d-088f66467896"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:31:01.810798 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-5e5154c6-f354-4e72-9fb7-c0e3c7c76303 req-fc8f5b83-890a-4fac-90cb-23e0adda17b9 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:01.811264 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-5e5154c6-f354-4e72-9fb7-c0e3c7c76303 req-fc8f5b83-890a-4fac-90cb-23e0adda17b9 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:01.822912 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.compute.server_external_events [req-5e5154c6-f354-4e72-9fb7-c0e3c7c76303 req-fc8f5b83-890a-4fac-90cb-23e0adda17b9 service nova] Creating event network-vif-deleted:57f39dbb-16f2-45cb-b50d-088f66467896 for instance 5c9fbfb9-a377-40af-9553-6670308678cf on hv-cinder-80378 Jun 30 18:31:01.827696 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-5e5154c6-f354-4e72-9fb7-c0e3c7c76303 req-fc8f5b83-890a-4fac-90cb-23e0adda17b9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030453 Jun 30 18:31:01.828286 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 191/375] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:31:01.840858 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-f92689ce-b228-403b-be70-05046cda94db tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:01.850123 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-f92689ce-b228-403b-be70-05046cda94db tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf" status: 200 len: 1463 microversion: 2.1 time: 0.094346 Jun 30 18:31:01.850685 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 185/376] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:01 2022] GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf => generated 1463 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:01.913374 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-61b2d8b3-974a-436e-af7d-645112244a19 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:01.914077 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-61b2d8b3-974a-436e-af7d-645112244a19 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: d6c61f3b-a138-4d3c-971d-8f25d3124178] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:01.920170 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-61b2d8b3-974a-436e-af7d-645112244a19 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:01.920606 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-61b2d8b3-974a-436e-af7d-645112244a19 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:01.921508 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-61b2d8b3-974a-436e-af7d-645112244a19 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:01.921957 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-61b2d8b3-974a-436e-af7d-645112244a19 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:02.055399 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-61b2d8b3-974a-436e-af7d-645112244a19 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:02.062936 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-61b2d8b3-974a-436e-af7d-645112244a19 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178" status: 200 len: 1509 microversion: 2.1 time: 0.153765 Jun 30 18:31:02.063503 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 192/377] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:01 2022] GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:02.867398 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-304c2e99-b5e8-4e31-8c12-b217b03329c4 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:02.868010 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-304c2e99-b5e8-4e31-8c12-b217b03329c4 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 5c9fbfb9-a377-40af-9553-6670308678cf] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:02.874912 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-304c2e99-b5e8-4e31-8c12-b217b03329c4 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:02.875356 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-304c2e99-b5e8-4e31-8c12-b217b03329c4 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:02.876119 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-304c2e99-b5e8-4e31-8c12-b217b03329c4 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:02.876584 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-304c2e99-b5e8-4e31-8c12-b217b03329c4 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:02.907701 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-304c2e99-b5e8-4e31-8c12-b217b03329c4 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:02.908143 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-304c2e99-b5e8-4e31-8c12-b217b03329c4 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:02.908586 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.objects.instance [None req-304c2e99-b5e8-4e31-8c12-b217b03329c4 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lazy-loading 'fault' on Instance uuid 5c9fbfb9-a377-40af-9553-6670308678cf {{(pid=117940) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 18:31:02.955401 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-304c2e99-b5e8-4e31-8c12-b217b03329c4 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:02.962859 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-304c2e99-b5e8-4e31-8c12-b217b03329c4 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf" status: 200 len: 1304 microversion: 2.1 time: 0.099302 Jun 30 18:31:02.963420 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 186/378] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:02 2022] GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:03.080724 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-b7d91f83-d47c-4844-bf9a-52718587de7f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:03.081326 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-b7d91f83-d47c-4844-bf9a-52718587de7f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: d6c61f3b-a138-4d3c-971d-8f25d3124178] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:03.087945 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b7d91f83-d47c-4844-bf9a-52718587de7f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:03.088394 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b7d91f83-d47c-4844-bf9a-52718587de7f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:03.089141 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b7d91f83-d47c-4844-bf9a-52718587de7f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:03.089587 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b7d91f83-d47c-4844-bf9a-52718587de7f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:03.221898 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-b7d91f83-d47c-4844-bf9a-52718587de7f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:03.230115 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-b7d91f83-d47c-4844-bf9a-52718587de7f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178" status: 200 len: 1509 microversion: 2.1 time: 0.153713 Jun 30 18:31:03.231004 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 193/379] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:03 2022] GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:03.980331 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-7316df15-85cb-447d-b42a-c3c1a56f5e2b tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:03.980942 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-7316df15-85cb-447d-b42a-c3c1a56f5e2b tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 5c9fbfb9-a377-40af-9553-6670308678cf] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:03.988196 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7316df15-85cb-447d-b42a-c3c1a56f5e2b tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:03.988642 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7316df15-85cb-447d-b42a-c3c1a56f5e2b tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:03.989402 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7316df15-85cb-447d-b42a-c3c1a56f5e2b tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:03.989899 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7316df15-85cb-447d-b42a-c3c1a56f5e2b tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:04.022317 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7316df15-85cb-447d-b42a-c3c1a56f5e2b tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:04.022765 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7316df15-85cb-447d-b42a-c3c1a56f5e2b tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:04.023208 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.objects.instance [None req-7316df15-85cb-447d-b42a-c3c1a56f5e2b tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lazy-loading 'fault' on Instance uuid 5c9fbfb9-a377-40af-9553-6670308678cf {{(pid=117940) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 18:31:04.064118 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-7316df15-85cb-447d-b42a-c3c1a56f5e2b tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:04.071812 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-7316df15-85cb-447d-b42a-c3c1a56f5e2b tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf" status: 200 len: 1304 microversion: 2.1 time: 0.095259 Jun 30 18:31:04.072377 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 187/380] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:03 2022] GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:04.247938 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-2c657a2b-7275-4d1e-8a46-a56207494991 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:04.248472 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-2c657a2b-7275-4d1e-8a46-a56207494991 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: d6c61f3b-a138-4d3c-971d-8f25d3124178] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:04.255106 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2c657a2b-7275-4d1e-8a46-a56207494991 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:04.255550 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2c657a2b-7275-4d1e-8a46-a56207494991 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:04.256299 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2c657a2b-7275-4d1e-8a46-a56207494991 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:04.256805 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2c657a2b-7275-4d1e-8a46-a56207494991 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:04.386959 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-2c657a2b-7275-4d1e-8a46-a56207494991 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:04.394872 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-2c657a2b-7275-4d1e-8a46-a56207494991 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178" status: 200 len: 1509 microversion: 2.1 time: 0.150892 Jun 30 18:31:04.395430 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 194/381] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:04 2022] GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178 => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:05.089192 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-c07f7263-3eba-404f-accd-cfde7ded1a20 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:05.089835 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-c07f7263-3eba-404f-accd-cfde7ded1a20 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 5c9fbfb9-a377-40af-9553-6670308678cf] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:05.097795 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c07f7263-3eba-404f-accd-cfde7ded1a20 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:05.098263 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c07f7263-3eba-404f-accd-cfde7ded1a20 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:05.099029 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c07f7263-3eba-404f-accd-cfde7ded1a20 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:05.099466 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c07f7263-3eba-404f-accd-cfde7ded1a20 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:05.130803 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c07f7263-3eba-404f-accd-cfde7ded1a20 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:05.131273 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c07f7263-3eba-404f-accd-cfde7ded1a20 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:05.131720 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.objects.instance [None req-c07f7263-3eba-404f-accd-cfde7ded1a20 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lazy-loading 'fault' on Instance uuid 5c9fbfb9-a377-40af-9553-6670308678cf {{(pid=117940) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 18:31:05.172616 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-c07f7263-3eba-404f-accd-cfde7ded1a20 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:05.180226 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-c07f7263-3eba-404f-accd-cfde7ded1a20 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf" status: 200 len: 1304 microversion: 2.1 time: 0.095346 Jun 30 18:31:05.180787 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 188/382] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:05 2022] GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:05.412036 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-2adcb63e-7fa1-4eb9-8dae-169760669db5 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:05.413606 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-2adcb63e-7fa1-4eb9-8dae-169760669db5 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: d6c61f3b-a138-4d3c-971d-8f25d3124178] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:05.420165 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2adcb63e-7fa1-4eb9-8dae-169760669db5 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:05.420602 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2adcb63e-7fa1-4eb9-8dae-169760669db5 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:05.421355 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2adcb63e-7fa1-4eb9-8dae-169760669db5 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:05.421815 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2adcb63e-7fa1-4eb9-8dae-169760669db5 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:05.565867 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-2adcb63e-7fa1-4eb9-8dae-169760669db5 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:05.573346 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-2adcb63e-7fa1-4eb9-8dae-169760669db5 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178" status: 200 len: 1509 microversion: 2.1 time: 0.165784 Jun 30 18:31:05.573932 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 195/383] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:05 2022] GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178 => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:06.197080 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-26e456fb-4037-4726-9cc4-c9fe3283264e tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:06.197776 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-26e456fb-4037-4726-9cc4-c9fe3283264e tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 5c9fbfb9-a377-40af-9553-6670308678cf] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:06.204545 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-26e456fb-4037-4726-9cc4-c9fe3283264e tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:06.204994 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-26e456fb-4037-4726-9cc4-c9fe3283264e tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:06.205785 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-26e456fb-4037-4726-9cc4-c9fe3283264e tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:06.206252 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-26e456fb-4037-4726-9cc4-c9fe3283264e tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:06.239363 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-26e456fb-4037-4726-9cc4-c9fe3283264e tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:06.239808 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-26e456fb-4037-4726-9cc4-c9fe3283264e tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:06.240285 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.objects.instance [None req-26e456fb-4037-4726-9cc4-c9fe3283264e tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lazy-loading 'fault' on Instance uuid 5c9fbfb9-a377-40af-9553-6670308678cf {{(pid=117940) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 18:31:06.284473 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-26e456fb-4037-4726-9cc4-c9fe3283264e tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:06.292360 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-26e456fb-4037-4726-9cc4-c9fe3283264e tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf" status: 200 len: 1304 microversion: 2.1 time: 0.098980 Jun 30 18:31:06.293074 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 189/384] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:06 2022] GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:06.590702 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-fe5ea7ec-100c-4796-a732-406281d9afd0 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:06.591193 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-fe5ea7ec-100c-4796-a732-406281d9afd0 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: d6c61f3b-a138-4d3c-971d-8f25d3124178] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:06.601050 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fe5ea7ec-100c-4796-a732-406281d9afd0 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:06.601545 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fe5ea7ec-100c-4796-a732-406281d9afd0 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:06.602382 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fe5ea7ec-100c-4796-a732-406281d9afd0 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:06.602818 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fe5ea7ec-100c-4796-a732-406281d9afd0 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:06.623135 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:31:06.952932 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-fe5ea7ec-100c-4796-a732-406281d9afd0 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:06.960175 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-fe5ea7ec-100c-4796-a732-406281d9afd0 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178" status: 200 len: 1515 microversion: 2.1 time: 0.373956 Jun 30 18:31:06.960763 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 196/385] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:06 2022] GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178 => generated 1515 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:07.310039 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-720cfdb4-95b6-4eff-9c94-2dd43cefb40e tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:07.310648 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-720cfdb4-95b6-4eff-9c94-2dd43cefb40e tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 5c9fbfb9-a377-40af-9553-6670308678cf] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:07.313618 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:31:07.319756 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-720cfdb4-95b6-4eff-9c94-2dd43cefb40e tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:07.320185 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-720cfdb4-95b6-4eff-9c94-2dd43cefb40e tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:07.320942 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-720cfdb4-95b6-4eff-9c94-2dd43cefb40e tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:07.321375 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-720cfdb4-95b6-4eff-9c94-2dd43cefb40e tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:07.351986 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-720cfdb4-95b6-4eff-9c94-2dd43cefb40e tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:07.352427 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-720cfdb4-95b6-4eff-9c94-2dd43cefb40e tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:07.352869 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.objects.instance [None req-720cfdb4-95b6-4eff-9c94-2dd43cefb40e tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lazy-loading 'fault' on Instance uuid 5c9fbfb9-a377-40af-9553-6670308678cf {{(pid=117940) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 18:31:07.397663 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-720cfdb4-95b6-4eff-9c94-2dd43cefb40e tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:07.405358 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-720cfdb4-95b6-4eff-9c94-2dd43cefb40e tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf" status: 200 len: 1304 microversion: 2.1 time: 0.099268 Jun 30 18:31:07.405968 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 190/386] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:07 2022] GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:08.423023 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-8ccf8932-3bb9-45e8-b6b3-b743a65dd442 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:08.423709 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-8ccf8932-3bb9-45e8-b6b3-b743a65dd442 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 5c9fbfb9-a377-40af-9553-6670308678cf] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:08.429736 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8ccf8932-3bb9-45e8-b6b3-b743a65dd442 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:08.430179 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8ccf8932-3bb9-45e8-b6b3-b743a65dd442 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:08.430942 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8ccf8932-3bb9-45e8-b6b3-b743a65dd442 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:08.431350 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8ccf8932-3bb9-45e8-b6b3-b743a65dd442 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:08.463778 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8ccf8932-3bb9-45e8-b6b3-b743a65dd442 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:08.464214 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8ccf8932-3bb9-45e8-b6b3-b743a65dd442 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:08.464650 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.objects.instance [None req-8ccf8932-3bb9-45e8-b6b3-b743a65dd442 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lazy-loading 'fault' on Instance uuid 5c9fbfb9-a377-40af-9553-6670308678cf {{(pid=117941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 18:31:08.512748 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-8ccf8932-3bb9-45e8-b6b3-b743a65dd442 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:08.520162 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-8ccf8932-3bb9-45e8-b6b3-b743a65dd442 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf" status: 200 len: 1304 microversion: 2.1 time: 0.101949 Jun 30 18:31:08.520735 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 197/387] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:08 2022] GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:09.371777 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-b9f50b68-85d1-4913-8dcb-42d7619b4a19 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Action: 'create', calling method: .version_select at 0x7f18056ea940>, body: {"keypair": {"name": "tempest-keypair-779206522", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFY627e1IZgAbE2RQkTm1JDIobuN5LjKcniGw53rRgziEWU8DpvtHrtNb0Md/UAFqt4OcPCOIWwJOZYkssOLs2/3ey3oMwBLkRlksgWdNFQwcOoTmvXN9/UZ4olrlp2ZUA=="}} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:31:09.387448 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.quota [None req-b9f50b68-85d1-4913-8dcb-42d7619b4a19 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Getting quotas for project 89156f1867314be89e5108d5506b83a3. Resources: {'key_pairs'} {{(pid=117940) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 18:31:09.392205 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.quota [None req-b9f50b68-85d1-4913-8dcb-42d7619b4a19 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Getting quotas for user c66efdb1cc27467d85831617590c8b28 and project 89156f1867314be89e5108d5506b83a3. Resources: {'key_pairs'} {{(pid=117940) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 18:31:09.423692 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-b9f50b68-85d1-4913-8dcb-42d7619b4a19 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.056286 Jun 30 18:31:09.424332 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 191/388] 10.222.0.33 () {60 vars in 1158 bytes} [Thu Jun 30 18:31:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:31:09.537428 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-90e559f4-b9df-4aa8-9e14-4ef69b8edc4c tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:09.538302 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-90e559f4-b9df-4aa8-9e14-4ef69b8edc4c tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 5c9fbfb9-a377-40af-9553-6670308678cf] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:09.545062 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-90e559f4-b9df-4aa8-9e14-4ef69b8edc4c tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:09.545750 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-90e559f4-b9df-4aa8-9e14-4ef69b8edc4c tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:09.547999 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-90e559f4-b9df-4aa8-9e14-4ef69b8edc4c tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:09.548627 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-90e559f4-b9df-4aa8-9e14-4ef69b8edc4c tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:09.584047 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-90e559f4-b9df-4aa8-9e14-4ef69b8edc4c tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:09.584489 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-90e559f4-b9df-4aa8-9e14-4ef69b8edc4c tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:09.584934 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.objects.instance [None req-90e559f4-b9df-4aa8-9e14-4ef69b8edc4c tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lazy-loading 'fault' on Instance uuid 5c9fbfb9-a377-40af-9553-6670308678cf {{(pid=117941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 18:31:09.642457 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-90e559f4-b9df-4aa8-9e14-4ef69b8edc4c tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:09.651381 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-90e559f4-b9df-4aa8-9e14-4ef69b8edc4c tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf" status: 200 len: 1304 microversion: 2.1 time: 0.117601 Jun 30 18:31:09.652351 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 198/389] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:09 2022] GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf => generated 1304 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:10.668136 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-8f3eed4c-fa1e-4bbd-8c66-19d75e530c82 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:10.668725 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-8f3eed4c-fa1e-4bbd-8c66-19d75e530c82 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 5c9fbfb9-a377-40af-9553-6670308678cf] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:10.676365 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8f3eed4c-fa1e-4bbd-8c66-19d75e530c82 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:10.676807 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8f3eed4c-fa1e-4bbd-8c66-19d75e530c82 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:10.677584 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8f3eed4c-fa1e-4bbd-8c66-19d75e530c82 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:10.678026 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8f3eed4c-fa1e-4bbd-8c66-19d75e530c82 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:10.683081 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:31:10.714503 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8f3eed4c-fa1e-4bbd-8c66-19d75e530c82 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:10.715127 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8f3eed4c-fa1e-4bbd-8c66-19d75e530c82 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:10.715728 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.objects.instance [None req-8f3eed4c-fa1e-4bbd-8c66-19d75e530c82 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lazy-loading 'fault' on Instance uuid 5c9fbfb9-a377-40af-9553-6670308678cf {{(pid=117940) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 18:31:10.762882 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-8f3eed4c-fa1e-4bbd-8c66-19d75e530c82 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:10.764026 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-94b2590e-0be7-41a6-9529-bbc00d615ebf tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-843165228", "imageRef": "636d6d52-5033-47e1-bf75-0b4fc50c0bb0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2d22caf1-f6f9-42ca-8270-c3e0450297eb"}], "security_groups": [{"name": "tempest-securitygroup--151236860"}], "key_name": "tempest-keypair-779206522", "user_data": "}} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:31:10.770670 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-8f3eed4c-fa1e-4bbd-8c66-19d75e530c82 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf" status: 200 len: 1304 microversion: 2.1 time: 0.106331 Jun 30 18:31:10.771228 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 192/390] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:10 2022] GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf => generated 1304 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:10.869900 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.network.neutron [None req-94b2590e-0be7-41a6-9529-bbc00d615ebf tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] validate_networks() for [('2d22caf1-f6f9-42ca-8270-c3e0450297eb', None, None, None, None, None)] {{(pid=117941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 18:31:11.268300 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.virt.hardware [None req-94b2590e-0be7-41a6-9529-bbc00d615ebf tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Flavor limits 0:0:0 {{(pid=117941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 18:31:11.268739 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.virt.hardware [None req-94b2590e-0be7-41a6-9529-bbc00d615ebf tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Image limits 0:0:0 {{(pid=117941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 18:31:11.269208 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.virt.hardware [None req-94b2590e-0be7-41a6-9529-bbc00d615ebf tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Flavor pref 0:0:0 {{(pid=117941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 18:31:11.269636 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.virt.hardware [None req-94b2590e-0be7-41a6-9529-bbc00d615ebf tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Image pref 0:0:0 {{(pid=117941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 18:31:11.270057 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.virt.hardware [None req-94b2590e-0be7-41a6-9529-bbc00d615ebf tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 18:31:11.278897 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-94b2590e-0be7-41a6-9529-bbc00d615ebf tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:11.279553 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-94b2590e-0be7-41a6-9529-bbc00d615ebf tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:11.280952 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-94b2590e-0be7-41a6-9529-bbc00d615ebf tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:11.281480 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-94b2590e-0be7-41a6-9529-bbc00d615ebf tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:11.298938 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.quota [None req-94b2590e-0be7-41a6-9529-bbc00d615ebf tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Getting quotas for project 89156f1867314be89e5108d5506b83a3. Resources: {'ram', 'instances', 'cores'} {{(pid=117941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 18:31:11.302848 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.quota [None req-94b2590e-0be7-41a6-9529-bbc00d615ebf tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Getting quotas for user c66efdb1cc27467d85831617590c8b28 and project 89156f1867314be89e5108d5506b83a3. Resources: {'ram', 'instances', 'cores'} {{(pid=117941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 18:31:11.313974 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-94b2590e-0be7-41a6-9529-bbc00d615ebf tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Going to run 1 instances... {{(pid=117941) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 18:31:11.316203 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-94b2590e-0be7-41a6-9529-bbc00d615ebf tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='636d6d52-5033-47e1-bf75-0b4fc50c0bb0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 18:31:11.364674 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-94b2590e-0be7-41a6-9529-bbc00d615ebf tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.605721 Jun 30 18:31:11.365328 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 199/391] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 30 18:31:10 2022] POST /compute/v2.1/servers => generated 408 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 18:31:11.376796 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-d277b5f2-4c6f-4733-ad79-4e82b4b6d316 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:11.377413 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-d277b5f2-4c6f-4733-ad79-4e82b4b6d316 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:11.439031 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-d277b5f2-4c6f-4733-ad79-4e82b4b6d316 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:11.451221 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-d277b5f2-4c6f-4733-ad79-4e82b4b6d316 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1244 microversion: 2.1 time: 0.079651 Jun 30 18:31:11.466014 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 193/392] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:11 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1244 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:11.788021 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-6f879afc-910e-40e3-a0c1-e8218639b36f tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:11.788930 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-6f879afc-910e-40e3-a0c1-e8218639b36f tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 5c9fbfb9-a377-40af-9553-6670308678cf] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:11.796468 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6f879afc-910e-40e3-a0c1-e8218639b36f tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:11.797133 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6f879afc-910e-40e3-a0c1-e8218639b36f tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:11.797996 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6f879afc-910e-40e3-a0c1-e8218639b36f tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:11.798429 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6f879afc-910e-40e3-a0c1-e8218639b36f tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:11.835155 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6f879afc-910e-40e3-a0c1-e8218639b36f tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:11.835599 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6f879afc-910e-40e3-a0c1-e8218639b36f tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:11.836046 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.objects.instance [None req-6f879afc-910e-40e3-a0c1-e8218639b36f tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lazy-loading 'fault' on Instance uuid 5c9fbfb9-a377-40af-9553-6670308678cf {{(pid=117941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 18:31:11.884260 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-6f879afc-910e-40e3-a0c1-e8218639b36f tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:11.892693 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-6f879afc-910e-40e3-a0c1-e8218639b36f tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf" status: 200 len: 1304 microversion: 2.1 time: 0.109293 Jun 30 18:31:11.893350 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 200/393] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:11 2022] GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf => generated 1304 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:12.473850 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-cf0908bd-a55f-4b43-844e-9dfb1a5361cf tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:12.474473 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-cf0908bd-a55f-4b43-844e-9dfb1a5361cf tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:12.481050 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cf0908bd-a55f-4b43-844e-9dfb1a5361cf tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:12.481496 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cf0908bd-a55f-4b43-844e-9dfb1a5361cf tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:12.482277 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cf0908bd-a55f-4b43-844e-9dfb1a5361cf tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:12.482708 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cf0908bd-a55f-4b43-844e-9dfb1a5361cf tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:12.545182 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-cf0908bd-a55f-4b43-844e-9dfb1a5361cf tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:12.553323 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-cf0908bd-a55f-4b43-844e-9dfb1a5361cf tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1248 microversion: 2.1 time: 0.083452 Jun 30 18:31:12.553911 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 194/394] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:12 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1248 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:12.910168 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-e39f4aa2-ef92-44e9-8e89-68c80c4619f0 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:12.910766 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-e39f4aa2-ef92-44e9-8e89-68c80c4619f0 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 5c9fbfb9-a377-40af-9553-6670308678cf] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:12.917296 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e39f4aa2-ef92-44e9-8e89-68c80c4619f0 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:12.917836 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e39f4aa2-ef92-44e9-8e89-68c80c4619f0 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:12.918595 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e39f4aa2-ef92-44e9-8e89-68c80c4619f0 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:12.919056 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e39f4aa2-ef92-44e9-8e89-68c80c4619f0 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:12.950524 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e39f4aa2-ef92-44e9-8e89-68c80c4619f0 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:12.950958 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e39f4aa2-ef92-44e9-8e89-68c80c4619f0 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:12.951784 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.objects.instance [None req-e39f4aa2-ef92-44e9-8e89-68c80c4619f0 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lazy-loading 'fault' on Instance uuid 5c9fbfb9-a377-40af-9553-6670308678cf {{(pid=117941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 18:31:12.992405 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-e39f4aa2-ef92-44e9-8e89-68c80c4619f0 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:13.000102 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-e39f4aa2-ef92-44e9-8e89-68c80c4619f0 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf" status: 200 len: 1304 microversion: 2.1 time: 0.093694 Jun 30 18:31:13.000693 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 201/395] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:12 2022] GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:13.570780 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-57750758-2403-4d11-94c8-29b805884765 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:13.571488 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-57750758-2403-4d11-94c8-29b805884765 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:13.579271 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-57750758-2403-4d11-94c8-29b805884765 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:13.579721 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-57750758-2403-4d11-94c8-29b805884765 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:13.580480 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-57750758-2403-4d11-94c8-29b805884765 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:13.580913 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-57750758-2403-4d11-94c8-29b805884765 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:13.647377 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-57750758-2403-4d11-94c8-29b805884765 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:13.658215 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-57750758-2403-4d11-94c8-29b805884765 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1248 microversion: 2.1 time: 0.092063 Jun 30 18:31:13.659117 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 195/396] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:13 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1248 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:14.016194 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-18cb2edd-3906-4aac-978e-8268553d368f tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:14.016729 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-18cb2edd-3906-4aac-978e-8268553d368f tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 5c9fbfb9-a377-40af-9553-6670308678cf] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:14.023292 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-18cb2edd-3906-4aac-978e-8268553d368f tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:14.023723 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-18cb2edd-3906-4aac-978e-8268553d368f tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:14.024605 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-18cb2edd-3906-4aac-978e-8268553d368f tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:14.024893 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-18cb2edd-3906-4aac-978e-8268553d368f tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:14.039107 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.wsgi [None req-18cb2edd-3906-4aac-978e-8268553d368f tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] HTTP exception thrown: Instance 5c9fbfb9-a377-40af-9553-6670308678cf could not be found. Jun 30 18:31:14.040730 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-18cb2edd-3906-4aac-978e-8268553d368f tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Request method failure captured: Jun 30 18:31:14.040730 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: request: GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf HTTP/1.1 Jun 30 18:31:14.040730 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept: application/json Jun 30 18:31:14.040730 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept-Encoding: identity Jun 30 18:31:14.040730 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Connection: close Jun 30 18:31:14.040730 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Length: 0 Jun 30 18:31:14.040730 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Type: application/json Jun 30 18:31:14.040730 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Host: 10.222.0.33 Jun 30 18:31:14.040730 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Openstack-System-Scope: None Jun 30 18:31:14.040730 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: User-Agent: python-urllib3/1.26.9 Jun 30 18:31:14.040730 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Auth-Token: gAAAAABivevKSoVwP-ZjmjkKOXjfi-WbD_QehQx5HUMegUP-HXgq3Qv0_pDjElExZS9ZvPkYxOw34n_aS_5q581Tta0St9m27UBc-L9YaepHp1eTHl4Yw_prqTOSUbCyhp2NKWcvLVRG_N6tbhYfNcLeWZ6__NF0IKtSbU43VJxARUCago0Ptyc Jun 30 18:31:14.040730 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Id: None Jun 30 18:31:14.040730 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Name: None Jun 30 18:31:14.040730 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Identity-Status: Confirmed Jun 30 18:31:14.040730 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Is-Admin-Project: True Jun 30 18:31:14.040730 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Id: default Jun 30 18:31:14.040730 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Name: Default Jun 30 18:31:14.040730 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Id: 116a07f168ef45e1b2f4e7a084fba32c Jun 30 18:31:14.040730 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Name: tempest-VolumesActionsTest-1098859793 Jun 30 18:31:14.040730 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Role: reader,member Jun 30 18:31:14.040730 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Roles: reader,member Jun 30 18:31:14.042351 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/116a07f168ef45e1b2f4e7a084fba32c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_116a07f168ef45e1b2f4e7a084fba32c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/116a07f168ef45e1b2f4e7a084fba32c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/116a07f168ef45e1b2f4e7a084fba32c"}]}] Jun 30 18:31:14.042351 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant: tempest-VolumesActionsTest-1098859793 Jun 30 18:31:14.042351 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Id: 116a07f168ef45e1b2f4e7a084fba32c Jun 30 18:31:14.042351 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Name: tempest-VolumesActionsTest-1098859793 Jun 30 18:31:14.042351 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User: tempest-VolumesActionsTest-1098859793-project Jun 30 18:31:14.042351 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Id: default Jun 30 18:31:14.042351 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Name: Default Jun 30 18:31:14.042351 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Id: 374555cda1b4424894093ebcc51cd651 Jun 30 18:31:14.042351 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Name: tempest-VolumesActionsTest-1098859793-project Jun 30 18:31:14.042351 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: method: > Jun 30 18:31:14.042351 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: exception: Instance 5c9fbfb9-a377-40af-9553-6670308678cf could not be found. Jun 30 18:31:14.042351 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: action_args: {'id': '5c9fbfb9-a377-40af-9553-6670308678cf'} Jun 30 18:31:14.043236 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:31:14.043236 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:31:14.043236 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:31:14.043236 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:31:14.043236 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:31:14.043236 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:31:14.043236 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:31:14.043236 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:31:14.043236 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:31:14.043236 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:31:14.043236 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c9fbfb9-a377-40af-9553-6670308678cf could not be found. Jun 30 18:31:14.043236 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:31:14.043236 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:31:14.043236 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:31:14.043236 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:31:14.043236 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:31:14.043236 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:31:14.043236 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:31:14.043236 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:31:14.043236 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:31:14.044681 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:31:14.044681 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:31:14.044681 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:31:14.044681 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:31:14.044681 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:31:14.044681 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:31:14.044681 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:31:14.044681 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c9fbfb9-a377-40af-9553-6670308678cf could not be found. Jun 30 18:31:14.044681 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:31:14.044681 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:31:14.044681 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:31:14.044681 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:31:14.044681 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:31:14.044681 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:31:14.044681 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:31:14.044681 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:31:14.044681 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c9fbfb9-a377-40af-9553-6670308678cf could not be found. Jun 30 18:31:14.044681 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:31:14.046575 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-18cb2edd-3906-4aac-978e-8268553d368f tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Returning 404 to user: Instance 5c9fbfb9-a377-40af-9553-6670308678cf could not be found. {{(pid=117941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:31:14.046575 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-18cb2edd-3906-4aac-978e-8268553d368f tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf" status: 404 len: 111 microversion: 2.1 time: 0.030084 Jun 30 18:31:14.046575 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 202/397] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:14 2022] GET /compute/v2.1/servers/5c9fbfb9-a377-40af-9553-6670308678cf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:31:14.160342 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-7e9e22ed-da12-4b4b-aedf-f46057ce6971 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-706644282", "imageRef": "636d6d52-5033-47e1-bf75-0b4fc50c0bb0", "flavorRef": "452", "networks": [{"uuid": "1f259826-30a8-477f-a1b0-8883730f55b5"}]}} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:31:14.217309 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.network.neutron [None req-7e9e22ed-da12-4b4b-aedf-f46057ce6971 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] validate_networks() for [('1f259826-30a8-477f-a1b0-8883730f55b5', None, None, None, None, None)] {{(pid=117940) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 18:31:14.644420 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-7e9e22ed-da12-4b4b-aedf-f46057ce6971 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Flavor limits 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 18:31:14.645082 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-7e9e22ed-da12-4b4b-aedf-f46057ce6971 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Image limits 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 18:31:14.645571 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-7e9e22ed-da12-4b4b-aedf-f46057ce6971 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Flavor pref 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 18:31:14.646414 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-7e9e22ed-da12-4b4b-aedf-f46057ce6971 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Image pref 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 18:31:14.646992 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-7e9e22ed-da12-4b4b-aedf-f46057ce6971 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 18:31:14.658829 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7e9e22ed-da12-4b4b-aedf-f46057ce6971 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:14.659525 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7e9e22ed-da12-4b4b-aedf-f46057ce6971 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:14.660494 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7e9e22ed-da12-4b4b-aedf-f46057ce6971 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:14.661064 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7e9e22ed-da12-4b4b-aedf-f46057ce6971 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:14.676801 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-9f3787ae-ba05-4be3-83b7-1b9f0948d217 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:14.677759 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-9f3787ae-ba05-4be3-83b7-1b9f0948d217 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:14.687483 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.quota [None req-7e9e22ed-da12-4b4b-aedf-f46057ce6971 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Getting quotas for project 116a07f168ef45e1b2f4e7a084fba32c. Resources: {'ram', 'instances', 'cores'} {{(pid=117940) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 18:31:14.687890 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9f3787ae-ba05-4be3-83b7-1b9f0948d217 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:14.688543 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9f3787ae-ba05-4be3-83b7-1b9f0948d217 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:14.689794 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9f3787ae-ba05-4be3-83b7-1b9f0948d217 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:14.690596 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9f3787ae-ba05-4be3-83b7-1b9f0948d217 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:14.693944 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.quota [None req-7e9e22ed-da12-4b4b-aedf-f46057ce6971 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Getting quotas for user 374555cda1b4424894093ebcc51cd651 and project 116a07f168ef45e1b2f4e7a084fba32c. Resources: {'ram', 'instances', 'cores'} {{(pid=117940) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 18:31:14.710173 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-7e9e22ed-da12-4b4b-aedf-f46057ce6971 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Going to run 1 instances... {{(pid=117940) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 18:31:14.710938 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-7e9e22ed-da12-4b4b-aedf-f46057ce6971 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='636d6d52-5033-47e1-bf75-0b4fc50c0bb0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117940) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 18:31:14.775082 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-7e9e22ed-da12-4b4b-aedf-f46057ce6971 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.618533 Jun 30 18:31:14.775692 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-9f3787ae-ba05-4be3-83b7-1b9f0948d217 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:14.777430 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 196/398] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 30 18:31:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 18:31:14.792811 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-eeb263e1-80bd-427f-8fe5-9af9b8167275 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:14.793021 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-9f3787ae-ba05-4be3-83b7-1b9f0948d217 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1296 microversion: 2.1 time: 0.118307 Jun 30 18:31:14.793703 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 203/399] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:14 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1296 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:31:14.794105 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-eeb263e1-80bd-427f-8fe5-9af9b8167275 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:14.899459 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-eeb263e1-80bd-427f-8fe5-9af9b8167275 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:14.906930 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-eeb263e1-80bd-427f-8fe5-9af9b8167275 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 200 len: 1213 microversion: 2.1 time: 0.119842 Jun 30 18:31:14.909653 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 197/400] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:14 2022] GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 1213 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:15.810957 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-bfd6cedd-9220-4add-ae65-4325313cab1b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:15.811737 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-bfd6cedd-9220-4add-ae65-4325313cab1b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:15.820209 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-bfd6cedd-9220-4add-ae65-4325313cab1b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:15.820479 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-bfd6cedd-9220-4add-ae65-4325313cab1b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:15.821260 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-bfd6cedd-9220-4add-ae65-4325313cab1b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:15.821723 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-bfd6cedd-9220-4add-ae65-4325313cab1b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:15.924349 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-5def2f99-63c5-4189-bfe1-5d6c400f6cdf tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:15.925022 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-5def2f99-63c5-4189-bfe1-5d6c400f6cdf tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:15.932037 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5def2f99-63c5-4189-bfe1-5d6c400f6cdf tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:15.932789 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5def2f99-63c5-4189-bfe1-5d6c400f6cdf tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:15.933831 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5def2f99-63c5-4189-bfe1-5d6c400f6cdf tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:15.934642 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5def2f99-63c5-4189-bfe1-5d6c400f6cdf tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:15.992647 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-bfd6cedd-9220-4add-ae65-4325313cab1b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:16.007135 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-5def2f99-63c5-4189-bfe1-5d6c400f6cdf tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:16.014755 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-bfd6cedd-9220-4add-ae65-4325313cab1b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1369 microversion: 2.1 time: 0.206045 Jun 30 18:31:16.025116 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 204/401] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:15 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1369 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:16.029333 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-5def2f99-63c5-4189-bfe1-5d6c400f6cdf tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 200 len: 1265 microversion: 2.1 time: 0.109311 Jun 30 18:31:16.030849 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 198/402] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:15 2022] GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 1265 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:16.738394 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-0c9d55e1-36e6-4213-9fe1-bc01946d119f req-787db901-d053-4080-aae0-920ed9d14fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0048b27f-0b3b-4654-8cf4-27f780ce5e90", "tag": "bdee779b-a164-4712-ad26-219f680c8a30"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:31:16.747756 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-0c9d55e1-36e6-4213-9fe1-bc01946d119f req-787db901-d053-4080-aae0-920ed9d14fb1 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:16.748356 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-0c9d55e1-36e6-4213-9fe1-bc01946d119f req-787db901-d053-4080-aae0-920ed9d14fb1 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:16.760328 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.compute.server_external_events [req-0c9d55e1-36e6-4213-9fe1-bc01946d119f req-787db901-d053-4080-aae0-920ed9d14fb1 service nova] Creating event network-changed:bdee779b-a164-4712-ad26-219f680c8a30 for instance 0048b27f-0b3b-4654-8cf4-27f780ce5e90 on hv-cinder-80378 Jun 30 18:31:16.765777 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-0c9d55e1-36e6-4213-9fe1-bc01946d119f req-787db901-d053-4080-aae0-920ed9d14fb1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031800 Jun 30 18:31:16.766390 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 205/403] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:31:17.032978 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-52cb2d8c-03aa-4940-8336-9cd58e946709 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:17.033595 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-52cb2d8c-03aa-4940-8336-9cd58e946709 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:17.040016 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-52cb2d8c-03aa-4940-8336-9cd58e946709 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:17.040456 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-52cb2d8c-03aa-4940-8336-9cd58e946709 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:17.041205 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-52cb2d8c-03aa-4940-8336-9cd58e946709 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:17.041668 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-52cb2d8c-03aa-4940-8336-9cd58e946709 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:17.049150 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-2431911b-b7f1-4104-9725-27684f6a48a7 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:17.049953 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-2431911b-b7f1-4104-9725-27684f6a48a7 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:17.056034 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2431911b-b7f1-4104-9725-27684f6a48a7 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:17.056474 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2431911b-b7f1-4104-9725-27684f6a48a7 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:17.057224 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2431911b-b7f1-4104-9725-27684f6a48a7 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:17.057680 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2431911b-b7f1-4104-9725-27684f6a48a7 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:17.141631 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-2431911b-b7f1-4104-9725-27684f6a48a7 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:17.148919 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-2431911b-b7f1-4104-9725-27684f6a48a7 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 200 len: 1271 microversion: 2.1 time: 0.105721 Jun 30 18:31:17.149721 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 206/404] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:17 2022] GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 1271 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:31:17.200595 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-52cb2d8c-03aa-4940-8336-9cd58e946709 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:17.208633 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-52cb2d8c-03aa-4940-8336-9cd58e946709 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1369 microversion: 2.1 time: 0.180085 Jun 30 18:31:17.209184 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 199/405] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:17 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1369 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:18.165856 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-6f8c06d3-ad9d-4e47-ac28-7d7c9237c6ad tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:18.166461 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-6f8c06d3-ad9d-4e47-ac28-7d7c9237c6ad tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:18.173352 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6f8c06d3-ad9d-4e47-ac28-7d7c9237c6ad tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:18.173819 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6f8c06d3-ad9d-4e47-ac28-7d7c9237c6ad tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:18.174569 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6f8c06d3-ad9d-4e47-ac28-7d7c9237c6ad tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:18.174993 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6f8c06d3-ad9d-4e47-ac28-7d7c9237c6ad tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:18.225169 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-ccf9502b-15a4-4e10-97fe-a4eb62be9e32 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:18.225965 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-ccf9502b-15a4-4e10-97fe-a4eb62be9e32 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:18.232315 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ccf9502b-15a4-4e10-97fe-a4eb62be9e32 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:18.232757 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ccf9502b-15a4-4e10-97fe-a4eb62be9e32 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:18.233518 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ccf9502b-15a4-4e10-97fe-a4eb62be9e32 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:18.234678 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ccf9502b-15a4-4e10-97fe-a4eb62be9e32 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:18.240651 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-6f8c06d3-ad9d-4e47-ac28-7d7c9237c6ad tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:18.248080 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-6f8c06d3-ad9d-4e47-ac28-7d7c9237c6ad tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 200 len: 1271 microversion: 2.1 time: 0.086012 Jun 30 18:31:18.248844 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 207/406] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:18 2022] GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:18.363651 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-ccf9502b-15a4-4e10-97fe-a4eb62be9e32 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:18.371067 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-ccf9502b-15a4-4e10-97fe-a4eb62be9e32 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1369 microversion: 2.1 time: 0.149690 Jun 30 18:31:18.371622 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 200/407] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:18 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1369 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:31:19.265377 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-91480046-12a8-4162-808c-477a0555909b tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:19.266009 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-91480046-12a8-4162-808c-477a0555909b tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:19.273435 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-91480046-12a8-4162-808c-477a0555909b tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:19.273902 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-91480046-12a8-4162-808c-477a0555909b tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:19.274649 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-91480046-12a8-4162-808c-477a0555909b tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:19.275071 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-91480046-12a8-4162-808c-477a0555909b tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:19.339478 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-91480046-12a8-4162-808c-477a0555909b tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:19.346896 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-91480046-12a8-4162-808c-477a0555909b tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 200 len: 1271 microversion: 2.1 time: 0.085402 Jun 30 18:31:19.347445 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 208/408] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:19 2022] GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:19.388195 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-1484574e-0e1c-4f42-9195-e2a7b5d53460 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:19.388808 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-1484574e-0e1c-4f42-9195-e2a7b5d53460 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:19.395308 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-1484574e-0e1c-4f42-9195-e2a7b5d53460 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:19.395753 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-1484574e-0e1c-4f42-9195-e2a7b5d53460 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:19.396513 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-1484574e-0e1c-4f42-9195-e2a7b5d53460 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:19.396962 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-1484574e-0e1c-4f42-9195-e2a7b5d53460 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:19.532719 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-1484574e-0e1c-4f42-9195-e2a7b5d53460 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:19.540029 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-1484574e-0e1c-4f42-9195-e2a7b5d53460 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1369 microversion: 2.1 time: 0.155713 Jun 30 18:31:19.540655 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 201/409] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:19 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1369 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:20.363815 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-bbb1f7a4-cb6c-4c34-819f-4576b7deefc2 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:20.364421 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-bbb1f7a4-cb6c-4c34-819f-4576b7deefc2 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:20.370884 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-bbb1f7a4-cb6c-4c34-819f-4576b7deefc2 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:20.371324 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-bbb1f7a4-cb6c-4c34-819f-4576b7deefc2 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:20.372073 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-bbb1f7a4-cb6c-4c34-819f-4576b7deefc2 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:20.372505 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-bbb1f7a4-cb6c-4c34-819f-4576b7deefc2 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:20.469906 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-bbb1f7a4-cb6c-4c34-819f-4576b7deefc2 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:20.477602 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-bbb1f7a4-cb6c-4c34-819f-4576b7deefc2 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 200 len: 1271 microversion: 2.1 time: 0.117492 Jun 30 18:31:20.478177 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 209/410] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:20 2022] GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 1271 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:20.559068 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-3a93b2ba-15e5-4923-a2f3-c4db1f803477 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:20.560484 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-3a93b2ba-15e5-4923-a2f3-c4db1f803477 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:20.574218 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3a93b2ba-15e5-4923-a2f3-c4db1f803477 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:20.574991 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3a93b2ba-15e5-4923-a2f3-c4db1f803477 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:20.576260 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3a93b2ba-15e5-4923-a2f3-c4db1f803477 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:20.577292 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3a93b2ba-15e5-4923-a2f3-c4db1f803477 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:20.820732 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-3a93b2ba-15e5-4923-a2f3-c4db1f803477 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:20.828443 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-3a93b2ba-15e5-4923-a2f3-c4db1f803477 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1369 microversion: 2.1 time: 0.275506 Jun 30 18:31:20.828940 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 202/411] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:20 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1369 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:21.491496 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell0:SELECT=2 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:31:21.492357 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell0:SELECT=6 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:31:21.497253 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-f00a1d4c-211d-469d-820b-5403b9895043 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:21.497999 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-f00a1d4c-211d-469d-820b-5403b9895043 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:21.506506 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f00a1d4c-211d-469d-820b-5403b9895043 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:21.506988 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f00a1d4c-211d-469d-820b-5403b9895043 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:21.507889 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f00a1d4c-211d-469d-820b-5403b9895043 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:21.508385 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f00a1d4c-211d-469d-820b-5403b9895043 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:21.725818 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-f00a1d4c-211d-469d-820b-5403b9895043 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:21.758445 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-f00a1d4c-211d-469d-820b-5403b9895043 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 200 len: 1313 microversion: 2.1 time: 0.265778 Jun 30 18:31:21.770141 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 210/412] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:21 2022] GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 1313 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:21.808493 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [req-c023de16-9e8a-4c39-8726-6264ad320820 req-49183dcb-8e0e-48d8-9136-1c0d73b63dc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a80fcde-066f-4051-b6a4-a49d064fce37", "tag": "018f0291-f685-44ed-acfe-67b0f47eeaa5"}]} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:31:21.818136 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-c023de16-9e8a-4c39-8726-6264ad320820 req-49183dcb-8e0e-48d8-9136-1c0d73b63dc8 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:21.818577 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-c023de16-9e8a-4c39-8726-6264ad320820 req-49183dcb-8e0e-48d8-9136-1c0d73b63dc8 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:21.834465 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.compute.server_external_events [req-c023de16-9e8a-4c39-8726-6264ad320820 req-49183dcb-8e0e-48d8-9136-1c0d73b63dc8 service nova] Creating event network-changed:018f0291-f685-44ed-acfe-67b0f47eeaa5 for instance 0a80fcde-066f-4051-b6a4-a49d064fce37 on hv-cinder-80378 Jun 30 18:31:21.840515 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [req-c023de16-9e8a-4c39-8726-6264ad320820 req-49183dcb-8e0e-48d8-9136-1c0d73b63dc8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035637 Jun 30 18:31:21.841373 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 203/413] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:31:21.845359 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-2ce74f75-5eea-412b-8ac3-981c5d5c4737 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:21.845998 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-2ce74f75-5eea-412b-8ac3-981c5d5c4737 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:21.848980 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:31:21.853019 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2ce74f75-5eea-412b-8ac3-981c5d5c4737 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:21.853466 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2ce74f75-5eea-412b-8ac3-981c5d5c4737 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:21.854268 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2ce74f75-5eea-412b-8ac3-981c5d5c4737 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:21.854701 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2ce74f75-5eea-412b-8ac3-981c5d5c4737 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:21.996514 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-2ce74f75-5eea-412b-8ac3-981c5d5c4737 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:22.004692 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-2ce74f75-5eea-412b-8ac3-981c5d5c4737 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1369 microversion: 2.1 time: 0.164163 Jun 30 18:31:22.005247 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 211/414] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:21 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1369 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:22.779246 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-f11591d7-9376-4dfc-a5f7-e3d773d02322 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:22.779949 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-f11591d7-9376-4dfc-a5f7-e3d773d02322 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:22.786946 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f11591d7-9376-4dfc-a5f7-e3d773d02322 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:22.787395 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f11591d7-9376-4dfc-a5f7-e3d773d02322 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:22.788155 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f11591d7-9376-4dfc-a5f7-e3d773d02322 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:22.788589 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f11591d7-9376-4dfc-a5f7-e3d773d02322 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:22.915443 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-f11591d7-9376-4dfc-a5f7-e3d773d02322 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:22.923420 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-f11591d7-9376-4dfc-a5f7-e3d773d02322 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 200 len: 1313 microversion: 2.1 time: 0.148399 Jun 30 18:31:22.923978 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 204/415] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:22 2022] GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:23.021134 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-427c5ac8-9723-41aa-a634-e8600bd868d2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:23.021787 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-427c5ac8-9723-41aa-a634-e8600bd868d2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:23.028626 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-427c5ac8-9723-41aa-a634-e8600bd868d2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:23.028738 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-427c5ac8-9723-41aa-a634-e8600bd868d2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:23.029435 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-427c5ac8-9723-41aa-a634-e8600bd868d2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:23.029898 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-427c5ac8-9723-41aa-a634-e8600bd868d2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:23.164288 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-427c5ac8-9723-41aa-a634-e8600bd868d2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:23.171742 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-427c5ac8-9723-41aa-a634-e8600bd868d2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1369 microversion: 2.1 time: 0.154252 Jun 30 18:31:23.172299 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 212/416] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:23 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1369 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:23.940658 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-61ad7836-b2a0-49f9-9f64-521338c17ff6 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:23.941262 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-61ad7836-b2a0-49f9-9f64-521338c17ff6 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:23.950646 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-61ad7836-b2a0-49f9-9f64-521338c17ff6 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:23.951090 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-61ad7836-b2a0-49f9-9f64-521338c17ff6 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:23.951862 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-61ad7836-b2a0-49f9-9f64-521338c17ff6 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:23.952784 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-61ad7836-b2a0-49f9-9f64-521338c17ff6 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:24.115457 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-61ad7836-b2a0-49f9-9f64-521338c17ff6 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:24.123121 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-61ad7836-b2a0-49f9-9f64-521338c17ff6 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 200 len: 1313 microversion: 2.1 time: 0.186700 Jun 30 18:31:24.123859 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 205/417] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:23 2022] GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:24.187266 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-32413337-794e-4e5c-b1e2-fde1fde3b54f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:24.187864 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-32413337-794e-4e5c-b1e2-fde1fde3b54f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:24.194703 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-32413337-794e-4e5c-b1e2-fde1fde3b54f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:24.195144 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-32413337-794e-4e5c-b1e2-fde1fde3b54f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:24.195897 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-32413337-794e-4e5c-b1e2-fde1fde3b54f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:24.196327 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-32413337-794e-4e5c-b1e2-fde1fde3b54f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:24.323084 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-32413337-794e-4e5c-b1e2-fde1fde3b54f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:24.326447 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell1:SELECT=100 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:31:24.332046 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-32413337-794e-4e5c-b1e2-fde1fde3b54f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1369 microversion: 2.1 time: 0.148642 Jun 30 18:31:24.332612 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 213/418] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:24 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1369 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:25.140043 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-42b734a6-11a2-4574-b84f-584e9caafd6c tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:25.140754 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-42b734a6-11a2-4574-b84f-584e9caafd6c tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:25.142726 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell0:SELECT=2 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:31:25.143411 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell0:SELECT=14 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:31:25.149831 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-42b734a6-11a2-4574-b84f-584e9caafd6c tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:25.150281 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-42b734a6-11a2-4574-b84f-584e9caafd6c tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:25.151052 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-42b734a6-11a2-4574-b84f-584e9caafd6c tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:25.151486 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-42b734a6-11a2-4574-b84f-584e9caafd6c tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:25.287031 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-42b734a6-11a2-4574-b84f-584e9caafd6c tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:25.294829 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-42b734a6-11a2-4574-b84f-584e9caafd6c tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 200 len: 1313 microversion: 2.1 time: 0.158703 Jun 30 18:31:25.295399 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 206/419] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:25 2022] GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:25.349002 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-32cdcbd4-a355-492b-9005-093a479656db tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:25.349631 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-32cdcbd4-a355-492b-9005-093a479656db tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:25.355976 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-32cdcbd4-a355-492b-9005-093a479656db tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:25.356417 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-32cdcbd4-a355-492b-9005-093a479656db tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:25.357168 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-32cdcbd4-a355-492b-9005-093a479656db tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:25.357613 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-32cdcbd4-a355-492b-9005-093a479656db tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:25.492406 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-32cdcbd4-a355-492b-9005-093a479656db tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:25.500616 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-32cdcbd4-a355-492b-9005-093a479656db tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1369 microversion: 2.1 time: 0.155307 Jun 30 18:31:25.501359 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 214/420] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:25 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1369 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:26.312811 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-c1648be6-01fc-4628-a07f-8af2c2500e0a tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:26.313427 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-c1648be6-01fc-4628-a07f-8af2c2500e0a tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:26.319790 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c1648be6-01fc-4628-a07f-8af2c2500e0a tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:26.320234 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c1648be6-01fc-4628-a07f-8af2c2500e0a tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:26.320996 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c1648be6-01fc-4628-a07f-8af2c2500e0a tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:26.321431 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c1648be6-01fc-4628-a07f-8af2c2500e0a tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:26.447567 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-c1648be6-01fc-4628-a07f-8af2c2500e0a tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:26.455401 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-c1648be6-01fc-4628-a07f-8af2c2500e0a tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 200 len: 1313 microversion: 2.1 time: 0.146717 Jun 30 18:31:26.455959 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 207/421] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:26 2022] GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:26.517299 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-20b5ec68-ca94-46fe-ba58-7bc21f623014 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:26.518003 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-20b5ec68-ca94-46fe-ba58-7bc21f623014 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:26.524534 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-20b5ec68-ca94-46fe-ba58-7bc21f623014 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:26.524980 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-20b5ec68-ca94-46fe-ba58-7bc21f623014 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:26.525773 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-20b5ec68-ca94-46fe-ba58-7bc21f623014 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:26.526211 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-20b5ec68-ca94-46fe-ba58-7bc21f623014 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:26.656018 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-20b5ec68-ca94-46fe-ba58-7bc21f623014 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:26.663373 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-20b5ec68-ca94-46fe-ba58-7bc21f623014 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1369 microversion: 2.1 time: 0.150656 Jun 30 18:31:26.664086 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 215/422] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:26 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1369 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:27.474580 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-4fdabdaa-9eea-4cf4-a43f-ac32bd90f67b tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:27.475258 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-4fdabdaa-9eea-4cf4-a43f-ac32bd90f67b tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:27.481713 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-4fdabdaa-9eea-4cf4-a43f-ac32bd90f67b tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:27.482420 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-4fdabdaa-9eea-4cf4-a43f-ac32bd90f67b tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:27.483265 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-4fdabdaa-9eea-4cf4-a43f-ac32bd90f67b tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:27.483699 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-4fdabdaa-9eea-4cf4-a43f-ac32bd90f67b tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:27.622884 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-4fdabdaa-9eea-4cf4-a43f-ac32bd90f67b tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:27.630889 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-4fdabdaa-9eea-4cf4-a43f-ac32bd90f67b tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 200 len: 1313 microversion: 2.1 time: 0.160300 Jun 30 18:31:27.631453 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 208/423] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:27 2022] GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:27.684343 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-92865b70-6e41-4541-8611-2c56597af4d6 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:27.685254 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-92865b70-6e41-4541-8611-2c56597af4d6 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:27.692182 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-92865b70-6e41-4541-8611-2c56597af4d6 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:27.692619 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-92865b70-6e41-4541-8611-2c56597af4d6 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:27.693653 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-92865b70-6e41-4541-8611-2c56597af4d6 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:27.694084 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-92865b70-6e41-4541-8611-2c56597af4d6 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:27.849926 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-92865b70-6e41-4541-8611-2c56597af4d6 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:27.862502 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-92865b70-6e41-4541-8611-2c56597af4d6 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1369 microversion: 2.1 time: 0.183546 Jun 30 18:31:27.863076 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 216/424] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:27 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1369 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:28.648203 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-553cf478-61ed-478d-aa34-a097dea0d8a7 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:28.648798 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-553cf478-61ed-478d-aa34-a097dea0d8a7 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:28.655621 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-553cf478-61ed-478d-aa34-a097dea0d8a7 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:28.656062 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-553cf478-61ed-478d-aa34-a097dea0d8a7 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:28.657482 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-553cf478-61ed-478d-aa34-a097dea0d8a7 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:28.657932 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-553cf478-61ed-478d-aa34-a097dea0d8a7 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:28.798227 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-553cf478-61ed-478d-aa34-a097dea0d8a7 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:28.805948 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-553cf478-61ed-478d-aa34-a097dea0d8a7 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 200 len: 1313 microversion: 2.1 time: 0.161791 Jun 30 18:31:28.806525 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 209/425] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:28 2022] GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:31:28.880276 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-2acb3460-9103-4754-8427-da714c85e167 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:28.880983 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-2acb3460-9103-4754-8427-da714c85e167 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:28.887570 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2acb3460-9103-4754-8427-da714c85e167 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:28.888092 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2acb3460-9103-4754-8427-da714c85e167 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:28.889042 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2acb3460-9103-4754-8427-da714c85e167 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:28.889539 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2acb3460-9103-4754-8427-da714c85e167 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:29.067025 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-2acb3460-9103-4754-8427-da714c85e167 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:29.074474 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-2acb3460-9103-4754-8427-da714c85e167 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1369 microversion: 2.1 time: 0.198961 Jun 30 18:31:29.075129 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 217/426] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:28 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1369 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:29.822959 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-597b5107-8362-4a59-a059-c083d39c4202 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:29.823568 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-597b5107-8362-4a59-a059-c083d39c4202 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:29.830909 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-597b5107-8362-4a59-a059-c083d39c4202 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:29.831358 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-597b5107-8362-4a59-a059-c083d39c4202 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:29.832127 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-597b5107-8362-4a59-a059-c083d39c4202 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:29.832561 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-597b5107-8362-4a59-a059-c083d39c4202 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:30.091869 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-0ac1fe2a-276c-451c-8615-a681844875d6 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:30.092473 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-0ac1fe2a-276c-451c-8615-a681844875d6 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:30.099307 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0ac1fe2a-276c-451c-8615-a681844875d6 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:30.099744 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0ac1fe2a-276c-451c-8615-a681844875d6 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:30.100504 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0ac1fe2a-276c-451c-8615-a681844875d6 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:30.100930 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0ac1fe2a-276c-451c-8615-a681844875d6 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:30.302323 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-597b5107-8362-4a59-a059-c083d39c4202 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:30.306318 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-0ac1fe2a-276c-451c-8615-a681844875d6 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:30.310520 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-597b5107-8362-4a59-a059-c083d39c4202 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 200 len: 1313 microversion: 2.1 time: 0.491375 Jun 30 18:31:30.311168 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 210/427] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:29 2022] GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 1313 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:30.318158 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-0ac1fe2a-276c-451c-8615-a681844875d6 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1369 microversion: 2.1 time: 0.230298 Jun 30 18:31:30.319188 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 218/428] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:30 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1369 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:31:31.327866 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-9b89716b-af6e-4da8-bcf1-0a978e1f9bf7 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:31.329095 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-9b89716b-af6e-4da8-bcf1-0a978e1f9bf7 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:31.335661 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9b89716b-af6e-4da8-bcf1-0a978e1f9bf7 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:31.335979 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-61f5480c-4fa2-4799-a0d8-cc9e4b76f10a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:31.336395 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9b89716b-af6e-4da8-bcf1-0a978e1f9bf7 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:31.336587 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-61f5480c-4fa2-4799-a0d8-cc9e4b76f10a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:31.336838 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9b89716b-af6e-4da8-bcf1-0a978e1f9bf7 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:31.337263 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9b89716b-af6e-4da8-bcf1-0a978e1f9bf7 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:31.342940 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-61f5480c-4fa2-4799-a0d8-cc9e4b76f10a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:31.343384 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-61f5480c-4fa2-4799-a0d8-cc9e4b76f10a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:31.344171 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-61f5480c-4fa2-4799-a0d8-cc9e4b76f10a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:31.344778 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-61f5480c-4fa2-4799-a0d8-cc9e4b76f10a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:31.543745 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-61f5480c-4fa2-4799-a0d8-cc9e4b76f10a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:31.546947 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-9b89716b-af6e-4da8-bcf1-0a978e1f9bf7 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:31.551940 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell1:SELECT=100 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:31:31.552230 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-61f5480c-4fa2-4799-a0d8-cc9e4b76f10a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1369 microversion: 2.1 time: 0.219998 Jun 30 18:31:31.553268 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 219/429] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:31 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1369 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:31:31.557386 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-9b89716b-af6e-4da8-bcf1-0a978e1f9bf7 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 200 len: 1313 microversion: 2.1 time: 0.233149 Jun 30 18:31:31.558978 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 211/430] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:31 2022] GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:32.569693 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-0dfa9e11-0646-474d-b1a3-95f391508b2c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:32.570273 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-0dfa9e11-0646-474d-b1a3-95f391508b2c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:32.576069 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-8444a3dd-6c13-4440-98cb-eef0c15aaeaf tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:32.576733 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0dfa9e11-0646-474d-b1a3-95f391508b2c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:32.577174 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0dfa9e11-0646-474d-b1a3-95f391508b2c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:32.577796 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-8444a3dd-6c13-4440-98cb-eef0c15aaeaf tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:32.577978 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0dfa9e11-0646-474d-b1a3-95f391508b2c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:32.578405 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0dfa9e11-0646-474d-b1a3-95f391508b2c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:32.585938 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8444a3dd-6c13-4440-98cb-eef0c15aaeaf tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:32.586386 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8444a3dd-6c13-4440-98cb-eef0c15aaeaf tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:32.587186 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8444a3dd-6c13-4440-98cb-eef0c15aaeaf tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:32.587648 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8444a3dd-6c13-4440-98cb-eef0c15aaeaf tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:32.779611 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-0dfa9e11-0646-474d-b1a3-95f391508b2c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:32.787133 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-0dfa9e11-0646-474d-b1a3-95f391508b2c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1369 microversion: 2.1 time: 0.221604 Jun 30 18:31:32.787691 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 220/431] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:32 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1369 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:32.794542 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-8444a3dd-6c13-4440-98cb-eef0c15aaeaf tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:32.803594 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-8444a3dd-6c13-4440-98cb-eef0c15aaeaf tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 200 len: 1313 microversion: 2.1 time: 0.231296 Jun 30 18:31:32.804184 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 212/432] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:32 2022] GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:31:33.806097 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-69152d36-6ec5-455f-bd4c-c9c05f5362a6 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:33.806824 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-69152d36-6ec5-455f-bd4c-c9c05f5362a6 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:33.816747 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-69152d36-6ec5-455f-bd4c-c9c05f5362a6 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:33.817399 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-69152d36-6ec5-455f-bd4c-c9c05f5362a6 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:33.818764 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-69152d36-6ec5-455f-bd4c-c9c05f5362a6 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:33.819354 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-69152d36-6ec5-455f-bd4c-c9c05f5362a6 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:33.820300 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-f4d2b40b-38d5-4489-b0b2-7baf1f9497f3 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:33.820908 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-f4d2b40b-38d5-4489-b0b2-7baf1f9497f3 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:33.827708 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f4d2b40b-38d5-4489-b0b2-7baf1f9497f3 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:33.828152 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f4d2b40b-38d5-4489-b0b2-7baf1f9497f3 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:33.829533 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f4d2b40b-38d5-4489-b0b2-7baf1f9497f3 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:33.830708 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f4d2b40b-38d5-4489-b0b2-7baf1f9497f3 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:34.099350 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-f4d2b40b-38d5-4489-b0b2-7baf1f9497f3 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:34.107018 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-f4d2b40b-38d5-4489-b0b2-7baf1f9497f3 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 200 len: 1313 microversion: 2.1 time: 0.290655 Jun 30 18:31:34.107803 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 213/433] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:33 2022] GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 1313 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:31:34.166904 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-69152d36-6ec5-455f-bd4c-c9c05f5362a6 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:34.183559 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-69152d36-6ec5-455f-bd4c-c9c05f5362a6 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1369 microversion: 2.1 time: 0.382994 Jun 30 18:31:34.184258 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 221/434] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:33 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1369 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:35.123818 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-68d866c2-6423-4fba-872c-b1446797eaee tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:35.124427 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-68d866c2-6423-4fba-872c-b1446797eaee tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:35.131035 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-68d866c2-6423-4fba-872c-b1446797eaee tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:35.131470 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-68d866c2-6423-4fba-872c-b1446797eaee tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:35.132218 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-68d866c2-6423-4fba-872c-b1446797eaee tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:35.132641 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-68d866c2-6423-4fba-872c-b1446797eaee tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:35.200660 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-db63a331-0a70-4fe7-8b1b-f12bea553551 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:35.201391 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-db63a331-0a70-4fe7-8b1b-f12bea553551 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:35.208356 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-db63a331-0a70-4fe7-8b1b-f12bea553551 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:35.208790 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-db63a331-0a70-4fe7-8b1b-f12bea553551 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:35.209540 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-db63a331-0a70-4fe7-8b1b-f12bea553551 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:35.209985 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-db63a331-0a70-4fe7-8b1b-f12bea553551 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:35.298211 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-68d866c2-6423-4fba-872c-b1446797eaee tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:35.305712 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-68d866c2-6423-4fba-872c-b1446797eaee tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 200 len: 1313 microversion: 2.1 time: 0.185582 Jun 30 18:31:35.306155 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 214/435] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:35 2022] GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:35.359092 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-db63a331-0a70-4fe7-8b1b-f12bea553551 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:35.367113 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-db63a331-0a70-4fe7-8b1b-f12bea553551 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1369 microversion: 2.1 time: 0.170289 Jun 30 18:31:35.367673 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 222/436] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:35 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1369 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:31:35.587128 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-bb49537c-e275-4343-b8ed-38dfb6fc99fc tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:35.587611 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-bb49537c-e275-4343-b8ed-38dfb6fc99fc tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: dac8aacd-66be-4695-a513-af3d837d9d47] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:35.593451 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-bb49537c-e275-4343-b8ed-38dfb6fc99fc tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:35.593912 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-bb49537c-e275-4343-b8ed-38dfb6fc99fc tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:35.594810 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-bb49537c-e275-4343-b8ed-38dfb6fc99fc tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:35.595253 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-bb49537c-e275-4343-b8ed-38dfb6fc99fc tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:35.726273 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.objects.instance [None req-bb49537c-e275-4343-b8ed-38dfb6fc99fc tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lazy-loading 'services' on Instance uuid dac8aacd-66be-4695-a513-af3d837d9d47 {{(pid=117940) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 18:31:35.841353 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-bb49537c-e275-4343-b8ed-38dfb6fc99fc tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "DELETE /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47/os-volume_attachments/d0174370-cc71-4587-ae8d-bde2b2dedec6" status: 202 len: 0 microversion: 2.1 time: 0.257904 Jun 30 18:31:35.841974 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 215/437] 10.222.0.33 () {58 vars in 1415 bytes} [Thu Jun 30 18:31:35 2022] DELETE /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47/os-volume_attachments/d0174370-cc71-4587-ae8d-bde2b2dedec6 => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 18:31:36.322869 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-5b804c35-f549-4c2b-b4c0-c7dcf0016620 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:36.323565 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-5b804c35-f549-4c2b-b4c0-c7dcf0016620 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:36.330338 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-5b804c35-f549-4c2b-b4c0-c7dcf0016620 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:36.330813 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-5b804c35-f549-4c2b-b4c0-c7dcf0016620 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:36.331582 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-5b804c35-f549-4c2b-b4c0-c7dcf0016620 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:36.332014 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-5b804c35-f549-4c2b-b4c0-c7dcf0016620 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:36.356227 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [req-0449fce6-f43d-45e0-901a-0d2a18bdf901 req-eed84dab-cb62-483a-a7b6-88f2ace4a012 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0048b27f-0b3b-4654-8cf4-27f780ce5e90", "name": "network-vif-plugged", "status": "completed", "tag": "bdee779b-a164-4712-ad26-219f680c8a30"}]} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:31:36.365847 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-0449fce6-f43d-45e0-901a-0d2a18bdf901 req-eed84dab-cb62-483a-a7b6-88f2ace4a012 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:36.366321 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-0449fce6-f43d-45e0-901a-0d2a18bdf901 req-eed84dab-cb62-483a-a7b6-88f2ace4a012 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:36.377747 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.compute.server_external_events [req-0449fce6-f43d-45e0-901a-0d2a18bdf901 req-eed84dab-cb62-483a-a7b6-88f2ace4a012 service nova] Creating event network-vif-plugged:bdee779b-a164-4712-ad26-219f680c8a30 for instance 0048b27f-0b3b-4654-8cf4-27f780ce5e90 on hv-cinder-80378 Jun 30 18:31:36.383194 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [req-0449fce6-f43d-45e0-901a-0d2a18bdf901 req-eed84dab-cb62-483a-a7b6-88f2ace4a012 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031504 Jun 30 18:31:36.383839 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 216/438] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:31:36.389026 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-c8f6ff47-acd8-4c72-b749-c64c31666514 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:36.389741 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-c8f6ff47-acd8-4c72-b749-c64c31666514 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:36.396144 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c8f6ff47-acd8-4c72-b749-c64c31666514 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:36.396801 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c8f6ff47-acd8-4c72-b749-c64c31666514 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:36.397561 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c8f6ff47-acd8-4c72-b749-c64c31666514 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:36.398019 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c8f6ff47-acd8-4c72-b749-c64c31666514 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:36.538958 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-5b804c35-f549-4c2b-b4c0-c7dcf0016620 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:36.546493 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-5b804c35-f549-4c2b-b4c0-c7dcf0016620 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 200 len: 1313 microversion: 2.1 time: 0.227688 Jun 30 18:31:36.556688 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 223/439] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:36 2022] GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 1313 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:36.571148 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-c8f6ff47-acd8-4c72-b749-c64c31666514 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:36.578406 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-c8f6ff47-acd8-4c72-b749-c64c31666514 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1369 microversion: 2.1 time: 0.193334 Jun 30 18:31:36.579772 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 217/440] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:36 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1369 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:37.247983 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-e7a35294-54a7-40f7-ab9a-4331480d3924 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1126126702", "imageRef": "636d6d52-5033-47e1-bf75-0b4fc50c0bb0", "flavorRef": "452"}} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:31:37.296672 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.network.neutron [None req-e7a35294-54a7-40f7-ab9a-4331480d3924 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] validate_networks() for None {{(pid=117941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 18:31:37.565806 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-bbe420e0-aeca-4727-a923-e530d6803d58 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:37.566493 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-bbe420e0-aeca-4727-a923-e530d6803d58 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:37.569256 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:31:37.575613 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-bbe420e0-aeca-4727-a923-e530d6803d58 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:37.576083 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.virt.hardware [None req-e7a35294-54a7-40f7-ab9a-4331480d3924 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Flavor limits 0:0:0 {{(pid=117941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 18:31:37.576515 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-bbe420e0-aeca-4727-a923-e530d6803d58 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:37.576628 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.virt.hardware [None req-e7a35294-54a7-40f7-ab9a-4331480d3924 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Image limits 0:0:0 {{(pid=117941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 18:31:37.576902 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-bbe420e0-aeca-4727-a923-e530d6803d58 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:37.577032 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.virt.hardware [None req-e7a35294-54a7-40f7-ab9a-4331480d3924 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Flavor pref 0:0:0 {{(pid=117941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 18:31:37.577335 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-bbe420e0-aeca-4727-a923-e530d6803d58 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:37.577457 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.virt.hardware [None req-e7a35294-54a7-40f7-ab9a-4331480d3924 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Image pref 0:0:0 {{(pid=117941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 18:31:37.577836 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.virt.hardware [None req-e7a35294-54a7-40f7-ab9a-4331480d3924 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 18:31:37.590548 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e7a35294-54a7-40f7-ab9a-4331480d3924 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:37.591490 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e7a35294-54a7-40f7-ab9a-4331480d3924 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:37.592667 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e7a35294-54a7-40f7-ab9a-4331480d3924 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:37.593394 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e7a35294-54a7-40f7-ab9a-4331480d3924 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:37.621276 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.quota [None req-e7a35294-54a7-40f7-ab9a-4331480d3924 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Getting quotas for project 72283c6d9d6b4f529e8f195c8ebbca64. Resources: {'ram', 'instances', 'cores'} {{(pid=117941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 18:31:37.627146 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.quota [None req-e7a35294-54a7-40f7-ab9a-4331480d3924 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Getting quotas for user 2d29f9c3387847b4bebaba3a1e3c0be8 and project 72283c6d9d6b4f529e8f195c8ebbca64. Resources: {'ram', 'instances', 'cores'} {{(pid=117941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 18:31:37.639207 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-e7a35294-54a7-40f7-ab9a-4331480d3924 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Going to run 1 instances... {{(pid=117941) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 18:31:37.641902 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-e7a35294-54a7-40f7-ab9a-4331480d3924 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='636d6d52-5033-47e1-bf75-0b4fc50c0bb0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 18:31:37.685603 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-e7a35294-54a7-40f7-ab9a-4331480d3924 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.441475 Jun 30 18:31:37.692326 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 224/441] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 30 18:31:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 443 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 18:31:37.697755 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-c7abc853-5b6c-4988-9ad3-52a070ca3166 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:37.698364 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-c7abc853-5b6c-4988-9ad3-52a070ca3166 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:37.705440 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c7abc853-5b6c-4988-9ad3-52a070ca3166 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:37.705907 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c7abc853-5b6c-4988-9ad3-52a070ca3166 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:37.706692 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c7abc853-5b6c-4988-9ad3-52a070ca3166 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:37.707116 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c7abc853-5b6c-4988-9ad3-52a070ca3166 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:37.730060 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-bbe420e0-aeca-4727-a923-e530d6803d58 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:37.739438 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-bbe420e0-aeca-4727-a923-e530d6803d58 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 200 len: 1313 microversion: 2.1 time: 0.179180 Jun 30 18:31:37.740012 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 218/442] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:37 2022] GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:31:37.745103 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-f44a1a4e-16ed-4717-a1ec-21e5a22dc65a tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:37.745942 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-f44a1a4e-16ed-4717-a1ec-21e5a22dc65a tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:37.845185 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-f44a1a4e-16ed-4717-a1ec-21e5a22dc65a tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:37.849873 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-f44a1a4e-16ed-4717-a1ec-21e5a22dc65a tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1215 microversion: 2.1 time: 0.108555 Jun 30 18:31:37.850606 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 219/443] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:37 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1215 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:37.889086 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-c7abc853-5b6c-4988-9ad3-52a070ca3166 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:37.897897 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-c7abc853-5b6c-4988-9ad3-52a070ca3166 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1369 microversion: 2.1 time: 0.210318 Jun 30 18:31:37.898459 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 225/444] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:37 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1369 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:38.757216 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-6c640f6f-53fb-4126-b193-b7a88aa88a46 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:38.757837 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-6c640f6f-53fb-4126-b193-b7a88aa88a46 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:38.764766 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6c640f6f-53fb-4126-b193-b7a88aa88a46 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:38.765206 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6c640f6f-53fb-4126-b193-b7a88aa88a46 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:38.766121 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6c640f6f-53fb-4126-b193-b7a88aa88a46 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:38.767097 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6c640f6f-53fb-4126-b193-b7a88aa88a46 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:38.867759 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-f304ed22-f9b4-45ef-8205-e210a46e4401 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:38.868471 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-f304ed22-f9b4-45ef-8205-e210a46e4401 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:38.875208 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f304ed22-f9b4-45ef-8205-e210a46e4401 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:38.876705 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f304ed22-f9b4-45ef-8205-e210a46e4401 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:38.877487 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f304ed22-f9b4-45ef-8205-e210a46e4401 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:38.878085 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f304ed22-f9b4-45ef-8205-e210a46e4401 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:38.898913 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-6c640f6f-53fb-4126-b193-b7a88aa88a46 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:38.906251 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-6c640f6f-53fb-4126-b193-b7a88aa88a46 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 200 len: 1313 microversion: 2.1 time: 0.152963 Jun 30 18:31:38.906978 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 220/445] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:38 2022] GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:38.914259 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-b93ed36c-f93e-486e-b808-e271b9b8f701 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:38.914891 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-b93ed36c-f93e-486e-b808-e271b9b8f701 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:38.921146 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b93ed36c-f93e-486e-b808-e271b9b8f701 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:38.921613 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b93ed36c-f93e-486e-b808-e271b9b8f701 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:38.922878 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b93ed36c-f93e-486e-b808-e271b9b8f701 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:38.923547 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b93ed36c-f93e-486e-b808-e271b9b8f701 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:38.946391 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-f304ed22-f9b4-45ef-8205-e210a46e4401 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:38.955709 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-f304ed22-f9b4-45ef-8205-e210a46e4401 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1219 microversion: 2.1 time: 0.092264 Jun 30 18:31:38.956489 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 226/446] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:38 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:31:39.068311 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-b93ed36c-f93e-486e-b808-e271b9b8f701 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:39.076409 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-b93ed36c-f93e-486e-b808-e271b9b8f701 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1369 microversion: 2.1 time: 0.165788 Jun 30 18:31:39.076911 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 221/447] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:38 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1369 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:31:39.923568 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-86d4bac3-6c51-4e65-bbd2-8a9055b10fe4 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:39.924261 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-86d4bac3-6c51-4e65-bbd2-8a9055b10fe4 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:39.931709 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-86d4bac3-6c51-4e65-bbd2-8a9055b10fe4 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:39.932150 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-86d4bac3-6c51-4e65-bbd2-8a9055b10fe4 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:39.933083 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-86d4bac3-6c51-4e65-bbd2-8a9055b10fe4 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:39.934071 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-86d4bac3-6c51-4e65-bbd2-8a9055b10fe4 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:39.972269 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-597ac5c8-d1ef-429d-bbf2-c60f3cef5f41 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:39.972880 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-597ac5c8-d1ef-429d-bbf2-c60f3cef5f41 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:39.979451 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-597ac5c8-d1ef-429d-bbf2-c60f3cef5f41 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:39.979899 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-597ac5c8-d1ef-429d-bbf2-c60f3cef5f41 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:39.980668 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-597ac5c8-d1ef-429d-bbf2-c60f3cef5f41 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:39.981102 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-597ac5c8-d1ef-429d-bbf2-c60f3cef5f41 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:40.053412 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-597ac5c8-d1ef-429d-bbf2-c60f3cef5f41 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:40.060874 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-597ac5c8-d1ef-429d-bbf2-c60f3cef5f41 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1211 microversion: 2.1 time: 0.092518 Jun 30 18:31:40.061834 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 222/448] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:39 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1211 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:40.094155 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-86d4bac3-6c51-4e65-bbd2-8a9055b10fe4 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:40.097882 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-1187b051-aa62-4abf-a8f8-d8715053507f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:40.098611 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-1187b051-aa62-4abf-a8f8-d8715053507f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:40.101775 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-86d4bac3-6c51-4e65-bbd2-8a9055b10fe4 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 200 len: 1313 microversion: 2.1 time: 0.182437 Jun 30 18:31:40.102352 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 227/449] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:39 2022] GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:40.104905 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-1187b051-aa62-4abf-a8f8-d8715053507f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:40.105351 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-1187b051-aa62-4abf-a8f8-d8715053507f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:40.106147 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-1187b051-aa62-4abf-a8f8-d8715053507f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:40.106580 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-1187b051-aa62-4abf-a8f8-d8715053507f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:40.242101 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-1187b051-aa62-4abf-a8f8-d8715053507f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:40.249284 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-1187b051-aa62-4abf-a8f8-d8715053507f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1369 microversion: 2.1 time: 0.161024 Jun 30 18:31:40.249875 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 223/450] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:40 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1369 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:41.079158 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-37689cbb-bd49-4746-81fc-62bd62bb6a02 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:41.080383 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-37689cbb-bd49-4746-81fc-62bd62bb6a02 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:41.089625 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-37689cbb-bd49-4746-81fc-62bd62bb6a02 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:41.089625 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-37689cbb-bd49-4746-81fc-62bd62bb6a02 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:41.089625 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-37689cbb-bd49-4746-81fc-62bd62bb6a02 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:41.089625 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-37689cbb-bd49-4746-81fc-62bd62bb6a02 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:41.119347 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-5f866955-54f1-4220-86fb-61aafb1dc74b tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:41.120098 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-5f866955-54f1-4220-86fb-61aafb1dc74b tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:41.127696 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5f866955-54f1-4220-86fb-61aafb1dc74b tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:41.128138 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5f866955-54f1-4220-86fb-61aafb1dc74b tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:41.128900 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5f866955-54f1-4220-86fb-61aafb1dc74b tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:41.129328 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5f866955-54f1-4220-86fb-61aafb1dc74b tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:41.161111 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-37689cbb-bd49-4746-81fc-62bd62bb6a02 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:41.169308 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-37689cbb-bd49-4746-81fc-62bd62bb6a02 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1211 microversion: 2.1 time: 0.094300 Jun 30 18:31:41.170515 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 228/451] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:41 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1211 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:41.175595 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-994a8821-223f-4336-887e-53cf9719be26 req-627ca77b-bd02-46f2-9b8b-75a58db03adc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a80fcde-066f-4051-b6a4-a49d064fce37", "name": "network-vif-plugged", "status": "completed", "tag": "018f0291-f685-44ed-acfe-67b0f47eeaa5"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:31:41.191732 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-994a8821-223f-4336-887e-53cf9719be26 req-627ca77b-bd02-46f2-9b8b-75a58db03adc service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:41.192171 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-994a8821-223f-4336-887e-53cf9719be26 req-627ca77b-bd02-46f2-9b8b-75a58db03adc service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:41.207168 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.compute.server_external_events [req-994a8821-223f-4336-887e-53cf9719be26 req-627ca77b-bd02-46f2-9b8b-75a58db03adc service nova] Creating event network-vif-plugged:018f0291-f685-44ed-acfe-67b0f47eeaa5 for instance 0a80fcde-066f-4051-b6a4-a49d064fce37 on hv-cinder-80378 Jun 30 18:31:41.213125 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-994a8821-223f-4336-887e-53cf9719be26 req-627ca77b-bd02-46f2-9b8b-75a58db03adc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041304 Jun 30 18:31:41.213926 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 229/452] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:31:41.269624 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-ee48b4ef-3f56-4587-b0b4-0dcf7b10d845 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:41.270312 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-ee48b4ef-3f56-4587-b0b4-0dcf7b10d845 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:41.276427 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ee48b4ef-3f56-4587-b0b4-0dcf7b10d845 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:41.276866 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ee48b4ef-3f56-4587-b0b4-0dcf7b10d845 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:41.277629 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ee48b4ef-3f56-4587-b0b4-0dcf7b10d845 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:41.278055 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ee48b4ef-3f56-4587-b0b4-0dcf7b10d845 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:41.295924 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-5f866955-54f1-4220-86fb-61aafb1dc74b tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:41.303653 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-5f866955-54f1-4220-86fb-61aafb1dc74b tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 200 len: 1313 microversion: 2.1 time: 0.188083 Jun 30 18:31:41.304470 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 224/453] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:41 2022] GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:31:41.413453 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-ee48b4ef-3f56-4587-b0b4-0dcf7b10d845 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:41.420927 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-ee48b4ef-3f56-4587-b0b4-0dcf7b10d845 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1369 microversion: 2.1 time: 0.156218 Jun 30 18:31:41.421482 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 230/454] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:41 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1369 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:31:42.186968 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-885b8120-0cea-4493-9851-c458b30b4464 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:42.187571 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-885b8120-0cea-4493-9851-c458b30b4464 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:42.195299 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-885b8120-0cea-4493-9851-c458b30b4464 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:42.195786 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-885b8120-0cea-4493-9851-c458b30b4464 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:42.196543 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-885b8120-0cea-4493-9851-c458b30b4464 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:42.196991 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-885b8120-0cea-4493-9851-c458b30b4464 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:42.262493 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-885b8120-0cea-4493-9851-c458b30b4464 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:42.269987 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-885b8120-0cea-4493-9851-c458b30b4464 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1211 microversion: 2.1 time: 0.086788 Jun 30 18:31:42.270567 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 225/455] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:42 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1211 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:42.320704 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-ded3c8bc-5920-4e39-ac4d-f74df7b857b4 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:42.321305 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-ded3c8bc-5920-4e39-ac4d-f74df7b857b4 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:42.327725 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ded3c8bc-5920-4e39-ac4d-f74df7b857b4 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:42.328162 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ded3c8bc-5920-4e39-ac4d-f74df7b857b4 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:42.328911 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ded3c8bc-5920-4e39-ac4d-f74df7b857b4 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:42.329338 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ded3c8bc-5920-4e39-ac4d-f74df7b857b4 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:42.437483 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-5a370caa-604e-48ed-aa7b-5fb25366b2bb tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:42.438417 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-5a370caa-604e-48ed-aa7b-5fb25366b2bb tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:42.444799 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5a370caa-604e-48ed-aa7b-5fb25366b2bb tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:42.445295 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5a370caa-604e-48ed-aa7b-5fb25366b2bb tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:42.446223 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5a370caa-604e-48ed-aa7b-5fb25366b2bb tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:42.446764 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5a370caa-604e-48ed-aa7b-5fb25366b2bb tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:42.461213 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-ded3c8bc-5920-4e39-ac4d-f74df7b857b4 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:42.464653 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell1:SELECT=100 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:31:42.469934 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-ded3c8bc-5920-4e39-ac4d-f74df7b857b4 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 200 len: 1313 microversion: 2.1 time: 0.152801 Jun 30 18:31:42.470696 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 231/456] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:42 2022] GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:42.576521 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-5a370caa-604e-48ed-aa7b-5fb25366b2bb tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:42.585142 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-5a370caa-604e-48ed-aa7b-5fb25366b2bb tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1369 microversion: 2.1 time: 0.151495 Jun 30 18:31:42.585743 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 226/457] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:42 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1369 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:31:43.287133 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-8589fcb9-b7c3-4a53-bd9f-b9cd3169ce39 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:43.287725 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-8589fcb9-b7c3-4a53-bd9f-b9cd3169ce39 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:43.293601 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8589fcb9-b7c3-4a53-bd9f-b9cd3169ce39 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:43.294042 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8589fcb9-b7c3-4a53-bd9f-b9cd3169ce39 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:43.294827 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8589fcb9-b7c3-4a53-bd9f-b9cd3169ce39 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:43.295248 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8589fcb9-b7c3-4a53-bd9f-b9cd3169ce39 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:43.362563 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-8589fcb9-b7c3-4a53-bd9f-b9cd3169ce39 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:43.370163 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-8589fcb9-b7c3-4a53-bd9f-b9cd3169ce39 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1211 microversion: 2.1 time: 0.087393 Jun 30 18:31:43.370716 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 232/458] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:43 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1211 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:43.486838 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-e8e772ef-fe0b-4ef3-8604-62f21750309f tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:43.487436 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-e8e772ef-fe0b-4ef3-8604-62f21750309f tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:43.493897 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e8e772ef-fe0b-4ef3-8604-62f21750309f tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:43.494342 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e8e772ef-fe0b-4ef3-8604-62f21750309f tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:43.495102 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e8e772ef-fe0b-4ef3-8604-62f21750309f tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:43.495538 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e8e772ef-fe0b-4ef3-8604-62f21750309f tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:43.601654 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-80dd3c5b-893d-463f-8432-5be48b777b64 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:43.602383 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-80dd3c5b-893d-463f-8432-5be48b777b64 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:43.608350 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-80dd3c5b-893d-463f-8432-5be48b777b64 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:43.608871 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-80dd3c5b-893d-463f-8432-5be48b777b64 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:43.609728 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-80dd3c5b-893d-463f-8432-5be48b777b64 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:43.610443 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-80dd3c5b-893d-463f-8432-5be48b777b64 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:43.626514 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-e8e772ef-fe0b-4ef3-8604-62f21750309f tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:43.633864 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-e8e772ef-fe0b-4ef3-8604-62f21750309f tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 200 len: 1313 microversion: 2.1 time: 0.151089 Jun 30 18:31:43.634437 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 227/459] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:43 2022] GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:43.737405 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-80dd3c5b-893d-463f-8432-5be48b777b64 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:43.744744 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-80dd3c5b-893d-463f-8432-5be48b777b64 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1369 microversion: 2.1 time: 0.146907 Jun 30 18:31:43.745316 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 233/460] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:43 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1369 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:31:44.387903 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-be2f97ea-9ad2-477b-91c5-eba6964a7d02 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:44.388516 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-be2f97ea-9ad2-477b-91c5-eba6964a7d02 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:44.395207 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-be2f97ea-9ad2-477b-91c5-eba6964a7d02 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:44.395652 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-be2f97ea-9ad2-477b-91c5-eba6964a7d02 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:44.396408 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-be2f97ea-9ad2-477b-91c5-eba6964a7d02 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:44.396843 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-be2f97ea-9ad2-477b-91c5-eba6964a7d02 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:44.460106 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-be2f97ea-9ad2-477b-91c5-eba6964a7d02 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:44.467355 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-be2f97ea-9ad2-477b-91c5-eba6964a7d02 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1211 microversion: 2.1 time: 0.083359 Jun 30 18:31:44.467906 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 228/461] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:44 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1211 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:44.651196 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-d7bceb7a-3cc0-4e4e-b187-b975f6e421f8 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:44.651801 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-d7bceb7a-3cc0-4e4e-b187-b975f6e421f8 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:44.658635 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d7bceb7a-3cc0-4e4e-b187-b975f6e421f8 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:44.659085 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d7bceb7a-3cc0-4e4e-b187-b975f6e421f8 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:44.659835 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d7bceb7a-3cc0-4e4e-b187-b975f6e421f8 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:44.660263 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d7bceb7a-3cc0-4e4e-b187-b975f6e421f8 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:44.762584 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-82fd3e54-3aeb-4ac2-8498-daeceb8266de tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:44.763414 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-82fd3e54-3aeb-4ac2-8498-daeceb8266de tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:44.771048 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-82fd3e54-3aeb-4ac2-8498-daeceb8266de tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:44.771576 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-82fd3e54-3aeb-4ac2-8498-daeceb8266de tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:44.772422 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-82fd3e54-3aeb-4ac2-8498-daeceb8266de tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:44.772949 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-82fd3e54-3aeb-4ac2-8498-daeceb8266de tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:44.793895 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:31:44.795060 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-d7bceb7a-3cc0-4e4e-b187-b975f6e421f8 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:44.803524 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-d7bceb7a-3cc0-4e4e-b187-b975f6e421f8 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 200 len: 1313 microversion: 2.1 time: 0.156137 Jun 30 18:31:44.804076 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 234/462] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:44 2022] GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:44.904462 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-82fd3e54-3aeb-4ac2-8498-daeceb8266de tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:44.912423 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-82fd3e54-3aeb-4ac2-8498-daeceb8266de tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1369 microversion: 2.1 time: 0.153804 Jun 30 18:31:44.913009 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 229/463] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:44 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1369 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:31:45.483947 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-2f79e490-7ac4-4879-9fec-720fdddae6a6 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:45.484551 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-2f79e490-7ac4-4879-9fec-720fdddae6a6 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:45.491330 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2f79e490-7ac4-4879-9fec-720fdddae6a6 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:45.491773 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2f79e490-7ac4-4879-9fec-720fdddae6a6 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:45.492523 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2f79e490-7ac4-4879-9fec-720fdddae6a6 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:45.492957 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2f79e490-7ac4-4879-9fec-720fdddae6a6 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:45.554099 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-2f79e490-7ac4-4879-9fec-720fdddae6a6 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:45.561498 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-2f79e490-7ac4-4879-9fec-720fdddae6a6 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1211 microversion: 2.1 time: 0.081321 Jun 30 18:31:45.562091 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 235/464] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:45 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1211 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:45.820726 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-2fe87b0e-c640-4788-bc91-3f7b3d7610f9 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:45.821334 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-2fe87b0e-c640-4788-bc91-3f7b3d7610f9 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:45.827872 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-2fe87b0e-c640-4788-bc91-3f7b3d7610f9 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:45.828313 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-2fe87b0e-c640-4788-bc91-3f7b3d7610f9 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:45.829807 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-2fe87b0e-c640-4788-bc91-3f7b3d7610f9 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:45.830243 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-2fe87b0e-c640-4788-bc91-3f7b3d7610f9 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:45.929667 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-fb73adc7-9bcb-4089-bdf2-5facb27eadb0 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:45.930296 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-fb73adc7-9bcb-4089-bdf2-5facb27eadb0 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:45.936604 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fb73adc7-9bcb-4089-bdf2-5facb27eadb0 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:45.937180 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fb73adc7-9bcb-4089-bdf2-5facb27eadb0 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:45.938542 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fb73adc7-9bcb-4089-bdf2-5facb27eadb0 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:45.939017 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fb73adc7-9bcb-4089-bdf2-5facb27eadb0 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:45.972869 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-2fe87b0e-c640-4788-bc91-3f7b3d7610f9 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:45.986242 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-2fe87b0e-c640-4788-bc91-3f7b3d7610f9 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 200 len: 1313 microversion: 2.1 time: 0.169365 Jun 30 18:31:45.987185 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 230/465] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:45 2022] GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:46.113224 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-fb73adc7-9bcb-4089-bdf2-5facb27eadb0 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:46.120797 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-fb73adc7-9bcb-4089-bdf2-5facb27eadb0 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1369 microversion: 2.1 time: 0.195243 Jun 30 18:31:46.121361 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 236/466] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:45 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1369 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:31:46.518764 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-39c0febb-8561-4f1b-9717-d6ec02b41faf tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:46.519244 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-39c0febb-8561-4f1b-9717-d6ec02b41faf tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: dac8aacd-66be-4695-a513-af3d837d9d47] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:46.525152 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-39c0febb-8561-4f1b-9717-d6ec02b41faf tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:46.525663 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-39c0febb-8561-4f1b-9717-d6ec02b41faf tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:46.526420 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-39c0febb-8561-4f1b-9717-d6ec02b41faf tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:46.526860 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-39c0febb-8561-4f1b-9717-d6ec02b41faf tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:46.551551 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-39c0febb-8561-4f1b-9717-d6ec02b41faf tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: dac8aacd-66be-4695-a513-af3d837d9d47] Going to try to terminate instance {{(pid=117940) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 18:31:46.578892 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-d266c44d-62cc-46f6-ac10-f29016224f6e tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:46.579574 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-d266c44d-62cc-46f6-ac10-f29016224f6e tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:46.585474 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d266c44d-62cc-46f6-ac10-f29016224f6e tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:46.585945 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d266c44d-62cc-46f6-ac10-f29016224f6e tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:46.586690 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d266c44d-62cc-46f6-ac10-f29016224f6e tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:46.587491 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d266c44d-62cc-46f6-ac10-f29016224f6e tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:46.630596 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-39c0febb-8561-4f1b-9717-d6ec02b41faf tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "DELETE /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47" status: 204 len: 0 microversion: 2.1 time: 0.115539 Jun 30 18:31:46.631293 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 231/467] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 30 18:31:46 2022] DELETE /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 18:31:46.640165 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-211dd132-4dd0-4d54-83da-53c531d67ab5 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:46.640863 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-211dd132-4dd0-4d54-83da-53c531d67ab5 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: dac8aacd-66be-4695-a513-af3d837d9d47] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:46.646935 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-211dd132-4dd0-4d54-83da-53c531d67ab5 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:46.647391 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-211dd132-4dd0-4d54-83da-53c531d67ab5 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:46.648368 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-211dd132-4dd0-4d54-83da-53c531d67ab5 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:46.648606 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-211dd132-4dd0-4d54-83da-53c531d67ab5 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:46.650536 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-d266c44d-62cc-46f6-ac10-f29016224f6e tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:46.658064 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-d266c44d-62cc-46f6-ac10-f29016224f6e tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1211 microversion: 2.1 time: 0.083063 Jun 30 18:31:46.658643 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 237/468] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:46 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1211 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:31:46.779012 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-211dd132-4dd0-4d54-83da-53c531d67ab5 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:46.787939 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-211dd132-4dd0-4d54-83da-53c531d67ab5 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47" status: 200 len: 1560 microversion: 2.1 time: 0.152250 Jun 30 18:31:46.788508 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 232/469] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:46 2022] GET /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:31:47.003349 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-9d981603-6639-45b5-a36a-acfde1ebb541 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:47.003879 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-9d981603-6639-45b5-a36a-acfde1ebb541 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:47.010237 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9d981603-6639-45b5-a36a-acfde1ebb541 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:47.010674 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9d981603-6639-45b5-a36a-acfde1ebb541 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:47.011427 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9d981603-6639-45b5-a36a-acfde1ebb541 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:47.011834 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9d981603-6639-45b5-a36a-acfde1ebb541 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:47.137976 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-361f2a07-6dd9-46f3-80ee-8ce3b8148375 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:47.138594 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-361f2a07-6dd9-46f3-80ee-8ce3b8148375 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:47.145745 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-361f2a07-6dd9-46f3-80ee-8ce3b8148375 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:47.146197 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-361f2a07-6dd9-46f3-80ee-8ce3b8148375 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:47.146987 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-361f2a07-6dd9-46f3-80ee-8ce3b8148375 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:47.147419 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-361f2a07-6dd9-46f3-80ee-8ce3b8148375 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:47.172402 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-9d981603-6639-45b5-a36a-acfde1ebb541 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:47.180692 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-9d981603-6639-45b5-a36a-acfde1ebb541 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 200 len: 1313 microversion: 2.1 time: 0.181294 Jun 30 18:31:47.181262 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 238/470] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:46 2022] GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:47.284770 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-361f2a07-6dd9-46f3-80ee-8ce3b8148375 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:47.291996 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-361f2a07-6dd9-46f3-80ee-8ce3b8148375 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1369 microversion: 2.1 time: 0.157941 Jun 30 18:31:47.292548 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 233/471] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:47 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1369 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:31:47.674924 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-b1fbf0be-58e4-41cd-85e6-ef32314c8976 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:47.675434 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-b1fbf0be-58e4-41cd-85e6-ef32314c8976 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:47.677572 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell0:SELECT=2 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:31:47.678392 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell0:SELECT=6 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:31:47.684299 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b1fbf0be-58e4-41cd-85e6-ef32314c8976 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:47.684732 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b1fbf0be-58e4-41cd-85e6-ef32314c8976 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:47.685468 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b1fbf0be-58e4-41cd-85e6-ef32314c8976 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:47.685923 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b1fbf0be-58e4-41cd-85e6-ef32314c8976 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:47.746677 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-b1fbf0be-58e4-41cd-85e6-ef32314c8976 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:47.754816 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-b1fbf0be-58e4-41cd-85e6-ef32314c8976 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1211 microversion: 2.1 time: 0.083898 Jun 30 18:31:47.755377 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 239/472] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:47 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1211 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:47.804623 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-8ba257af-86f9-42c6-8e45-457eeaaff402 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:47.805227 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-8ba257af-86f9-42c6-8e45-457eeaaff402 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: dac8aacd-66be-4695-a513-af3d837d9d47] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:47.811167 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8ba257af-86f9-42c6-8e45-457eeaaff402 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:47.811614 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8ba257af-86f9-42c6-8e45-457eeaaff402 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:47.812371 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8ba257af-86f9-42c6-8e45-457eeaaff402 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:47.812805 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8ba257af-86f9-42c6-8e45-457eeaaff402 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:47.849865 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell0:SELECT=2 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:31:47.942770 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-8ba257af-86f9-42c6-8e45-457eeaaff402 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:47.950514 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-8ba257af-86f9-42c6-8e45-457eeaaff402 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47" status: 200 len: 1514 microversion: 2.1 time: 0.149650 Jun 30 18:31:47.951072 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 234/473] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:47 2022] GET /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:48.197700 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-8d24464a-d7be-46ae-9197-0e71f0987c2c tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:48.198244 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-8d24464a-d7be-46ae-9197-0e71f0987c2c tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:48.204715 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8d24464a-d7be-46ae-9197-0e71f0987c2c tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:48.205160 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8d24464a-d7be-46ae-9197-0e71f0987c2c tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:48.205945 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8d24464a-d7be-46ae-9197-0e71f0987c2c tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:48.206377 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8d24464a-d7be-46ae-9197-0e71f0987c2c tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:48.313845 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-0ce554be-d370-481a-96d6-989bc6e73448 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:48.313845 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-0ce554be-d370-481a-96d6-989bc6e73448 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:48.315486 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0ce554be-d370-481a-96d6-989bc6e73448 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:48.316102 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0ce554be-d370-481a-96d6-989bc6e73448 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:48.316934 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0ce554be-d370-481a-96d6-989bc6e73448 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:48.317439 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0ce554be-d370-481a-96d6-989bc6e73448 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:48.336952 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-8d24464a-d7be-46ae-9197-0e71f0987c2c tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:48.344901 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-8d24464a-d7be-46ae-9197-0e71f0987c2c tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 200 len: 1313 microversion: 2.1 time: 0.150786 Jun 30 18:31:48.345942 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 240/474] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:48 2022] GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:48.445995 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-0ce554be-d370-481a-96d6-989bc6e73448 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:48.453337 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-0ce554be-d370-481a-96d6-989bc6e73448 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1369 microversion: 2.1 time: 0.149030 Jun 30 18:31:48.453993 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 235/475] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:48 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1369 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:31:48.772186 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-44a73b82-2f76-4d81-98e7-11df75e245f3 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:48.772794 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-44a73b82-2f76-4d81-98e7-11df75e245f3 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:48.778795 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-44a73b82-2f76-4d81-98e7-11df75e245f3 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:48.779238 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-44a73b82-2f76-4d81-98e7-11df75e245f3 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:48.779988 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-44a73b82-2f76-4d81-98e7-11df75e245f3 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:48.780415 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-44a73b82-2f76-4d81-98e7-11df75e245f3 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:48.847936 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-44a73b82-2f76-4d81-98e7-11df75e245f3 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:48.855201 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-44a73b82-2f76-4d81-98e7-11df75e245f3 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1211 microversion: 2.1 time: 0.086903 Jun 30 18:31:48.855760 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 241/476] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:48 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1211 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:31:48.967019 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-02c42a80-2619-402e-aa88-dce8dbc25a48 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:48.967620 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-02c42a80-2619-402e-aa88-dce8dbc25a48 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: dac8aacd-66be-4695-a513-af3d837d9d47] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:48.974109 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-02c42a80-2619-402e-aa88-dce8dbc25a48 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:48.974550 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-02c42a80-2619-402e-aa88-dce8dbc25a48 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:48.975293 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-02c42a80-2619-402e-aa88-dce8dbc25a48 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:48.975716 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-02c42a80-2619-402e-aa88-dce8dbc25a48 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:49.108831 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-02c42a80-2619-402e-aa88-dce8dbc25a48 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:49.117290 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-02c42a80-2619-402e-aa88-dce8dbc25a48 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47" status: 200 len: 1514 microversion: 2.1 time: 0.154136 Jun 30 18:31:49.117896 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 236/477] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:48 2022] GET /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:49.361972 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-5e73523a-0298-47e5-b654-1d407471c5c8 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:49.362571 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-5e73523a-0298-47e5-b654-1d407471c5c8 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:49.368940 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-5e73523a-0298-47e5-b654-1d407471c5c8 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:49.369376 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-5e73523a-0298-47e5-b654-1d407471c5c8 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:49.370156 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-5e73523a-0298-47e5-b654-1d407471c5c8 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:49.370574 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-5e73523a-0298-47e5-b654-1d407471c5c8 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:49.470966 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-7908b06b-9668-4e8a-8d2e-c43d844d9fc2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:49.471556 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-7908b06b-9668-4e8a-8d2e-c43d844d9fc2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:49.482853 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7908b06b-9668-4e8a-8d2e-c43d844d9fc2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:49.483349 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7908b06b-9668-4e8a-8d2e-c43d844d9fc2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:49.484215 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7908b06b-9668-4e8a-8d2e-c43d844d9fc2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:49.484645 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7908b06b-9668-4e8a-8d2e-c43d844d9fc2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:49.513420 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-5e73523a-0298-47e5-b654-1d407471c5c8 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:49.522425 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-5e73523a-0298-47e5-b654-1d407471c5c8 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 200 len: 1313 microversion: 2.1 time: 0.164574 Jun 30 18:31:49.523040 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 242/478] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:49 2022] GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:49.628272 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-7908b06b-9668-4e8a-8d2e-c43d844d9fc2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:49.635780 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-7908b06b-9668-4e8a-8d2e-c43d844d9fc2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1563 microversion: 2.1 time: 0.169491 Jun 30 18:31:49.636359 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 237/479] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:49 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1563 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:49.653282 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-de777af1-cc0e-48cf-a7d1-2bc3851f5dc2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:49.653942 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-de777af1-cc0e-48cf-a7d1-2bc3851f5dc2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:49.659953 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-de777af1-cc0e-48cf-a7d1-2bc3851f5dc2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:49.660390 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-de777af1-cc0e-48cf-a7d1-2bc3851f5dc2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:49.661131 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-de777af1-cc0e-48cf-a7d1-2bc3851f5dc2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:49.661548 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-de777af1-cc0e-48cf-a7d1-2bc3851f5dc2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:49.739281 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-de777af1-cc0e-48cf-a7d1-2bc3851f5dc2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089813 Jun 30 18:31:49.739880 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 243/480] 10.222.0.33 () {58 vars in 1274 bytes} [Thu Jun 30 18:31:49 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:31:49.872292 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-3c121210-aba6-480b-8c41-e19ae15dd261 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:49.872847 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-3c121210-aba6-480b-8c41-e19ae15dd261 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:49.879095 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3c121210-aba6-480b-8c41-e19ae15dd261 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:49.879549 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3c121210-aba6-480b-8c41-e19ae15dd261 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:49.880306 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3c121210-aba6-480b-8c41-e19ae15dd261 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:49.880769 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3c121210-aba6-480b-8c41-e19ae15dd261 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:49.999324 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-3c121210-aba6-480b-8c41-e19ae15dd261 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:50.008858 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-3c121210-aba6-480b-8c41-e19ae15dd261 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1267 microversion: 2.1 time: 0.140423 Jun 30 18:31:50.009470 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 238/481] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:49 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1267 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:50.135733 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-d9a6a5c4-2124-4ef0-b0a5-e3795db292ff tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:50.136369 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-d9a6a5c4-2124-4ef0-b0a5-e3795db292ff tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: dac8aacd-66be-4695-a513-af3d837d9d47] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:50.143448 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d9a6a5c4-2124-4ef0-b0a5-e3795db292ff tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:50.143980 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d9a6a5c4-2124-4ef0-b0a5-e3795db292ff tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:50.144823 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d9a6a5c4-2124-4ef0-b0a5-e3795db292ff tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:50.145401 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d9a6a5c4-2124-4ef0-b0a5-e3795db292ff tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:50.524114 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-d9a6a5c4-2124-4ef0-b0a5-e3795db292ff tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:50.531458 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-d9a6a5c4-2124-4ef0-b0a5-e3795db292ff tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47" status: 200 len: 1514 microversion: 2.1 time: 0.399667 Jun 30 18:31:50.532805 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 244/482] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:50 2022] GET /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47 => generated 1514 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:50.539094 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-14ba19c9-d144-4eb2-baed-c46ff40f0fdd tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:50.539734 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-14ba19c9-d144-4eb2-baed-c46ff40f0fdd tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:50.547094 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-14ba19c9-d144-4eb2-baed-c46ff40f0fdd tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:50.547568 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-14ba19c9-d144-4eb2-baed-c46ff40f0fdd tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:50.548366 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-14ba19c9-d144-4eb2-baed-c46ff40f0fdd tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:50.548863 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-14ba19c9-d144-4eb2-baed-c46ff40f0fdd tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:50.794936 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-14ba19c9-d144-4eb2-baed-c46ff40f0fdd tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:50.804940 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-14ba19c9-d144-4eb2-baed-c46ff40f0fdd tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 200 len: 1313 microversion: 2.1 time: 0.269702 Jun 30 18:31:50.805522 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 239/483] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:50 2022] GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 1313 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:51.025652 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-cd829f5e-6113-4216-aa76-a7ea5c9ce5ac tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:51.026264 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-cd829f5e-6113-4216-aa76-a7ea5c9ce5ac tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:51.032468 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-cd829f5e-6113-4216-aa76-a7ea5c9ce5ac tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:51.033392 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-cd829f5e-6113-4216-aa76-a7ea5c9ce5ac tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:51.034186 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-cd829f5e-6113-4216-aa76-a7ea5c9ce5ac tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:51.034611 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-cd829f5e-6113-4216-aa76-a7ea5c9ce5ac tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:51.075959 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [req-fcf8e9e6-8a56-44ff-9c55-eb98b0ccb4cd req-3e08b1f9-18cc-4119-b2ed-eab20bee8479 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0048b27f-0b3b-4654-8cf4-27f780ce5e90", "tag": "bdee779b-a164-4712-ad26-219f680c8a30"}]} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:31:51.084189 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-fcf8e9e6-8a56-44ff-9c55-eb98b0ccb4cd req-3e08b1f9-18cc-4119-b2ed-eab20bee8479 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:51.084621 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-fcf8e9e6-8a56-44ff-9c55-eb98b0ccb4cd req-3e08b1f9-18cc-4119-b2ed-eab20bee8479 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:51.096045 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.compute.server_external_events [req-fcf8e9e6-8a56-44ff-9c55-eb98b0ccb4cd req-3e08b1f9-18cc-4119-b2ed-eab20bee8479 service nova] Creating event network-changed:bdee779b-a164-4712-ad26-219f680c8a30 for instance 0048b27f-0b3b-4654-8cf4-27f780ce5e90 on hv-cinder-80378 Jun 30 18:31:51.100999 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [req-fcf8e9e6-8a56-44ff-9c55-eb98b0ccb4cd req-3e08b1f9-18cc-4119-b2ed-eab20bee8479 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028468 Jun 30 18:31:51.102817 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-cd829f5e-6113-4216-aa76-a7ea5c9ce5ac tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:51.104302 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 240/484] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:31:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:31:51.111301 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-cd829f5e-6113-4216-aa76-a7ea5c9ce5ac tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1267 microversion: 2.1 time: 0.089603 Jun 30 18:31:51.111853 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 245/485] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:51 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1267 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:51.549455 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-67fdde9d-91a3-46fe-9eb0-c7086024a4b0 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:51.550173 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-67fdde9d-91a3-46fe-9eb0-c7086024a4b0 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: dac8aacd-66be-4695-a513-af3d837d9d47] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:51.556490 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-67fdde9d-91a3-46fe-9eb0-c7086024a4b0 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:51.556927 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-67fdde9d-91a3-46fe-9eb0-c7086024a4b0 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:51.557693 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-67fdde9d-91a3-46fe-9eb0-c7086024a4b0 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:51.558120 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-67fdde9d-91a3-46fe-9eb0-c7086024a4b0 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:51.696430 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-67fdde9d-91a3-46fe-9eb0-c7086024a4b0 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:51.704368 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-67fdde9d-91a3-46fe-9eb0-c7086024a4b0 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47" status: 200 len: 1514 microversion: 2.1 time: 0.159331 Jun 30 18:31:51.705182 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 241/486] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:51 2022] GET /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:51.822313 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-69120d34-046f-42bd-93d3-f7e157fdeb38 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:51.822914 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-69120d34-046f-42bd-93d3-f7e157fdeb38 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:51.830563 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-69120d34-046f-42bd-93d3-f7e157fdeb38 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:51.830995 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-69120d34-046f-42bd-93d3-f7e157fdeb38 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:51.831741 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-69120d34-046f-42bd-93d3-f7e157fdeb38 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:51.832163 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-69120d34-046f-42bd-93d3-f7e157fdeb38 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:51.973284 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-69120d34-046f-42bd-93d3-f7e157fdeb38 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:51.982466 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-69120d34-046f-42bd-93d3-f7e157fdeb38 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 200 len: 1313 microversion: 2.1 time: 0.163746 Jun 30 18:31:51.983411 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 246/487] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:51 2022] GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:52.130301 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-316a6e6b-5fae-41ca-aaa2-6bb4e15f423b tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:52.130945 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-316a6e6b-5fae-41ca-aaa2-6bb4e15f423b tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:52.144482 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-316a6e6b-5fae-41ca-aaa2-6bb4e15f423b tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:52.144946 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-316a6e6b-5fae-41ca-aaa2-6bb4e15f423b tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:52.145801 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-316a6e6b-5fae-41ca-aaa2-6bb4e15f423b tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:52.146555 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-316a6e6b-5fae-41ca-aaa2-6bb4e15f423b tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:52.215259 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-316a6e6b-5fae-41ca-aaa2-6bb4e15f423b tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:52.222971 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-316a6e6b-5fae-41ca-aaa2-6bb4e15f423b tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1267 microversion: 2.1 time: 0.098775 Jun 30 18:31:52.223537 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 242/488] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:52 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1267 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:52.722454 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-5e29f759-bf59-44a3-848c-5286b21e5848 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:52.722986 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-5e29f759-bf59-44a3-848c-5286b21e5848 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: dac8aacd-66be-4695-a513-af3d837d9d47] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:52.724870 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:31:52.730513 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-5e29f759-bf59-44a3-848c-5286b21e5848 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:52.730962 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-5e29f759-bf59-44a3-848c-5286b21e5848 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:52.731725 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-5e29f759-bf59-44a3-848c-5286b21e5848 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:52.732155 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-5e29f759-bf59-44a3-848c-5286b21e5848 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:52.936606 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-5e29f759-bf59-44a3-848c-5286b21e5848 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:52.947803 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-5e29f759-bf59-44a3-848c-5286b21e5848 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47" status: 200 len: 1514 microversion: 2.1 time: 0.229925 Jun 30 18:31:52.958254 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 247/489] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:52 2022] GET /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47 => generated 1514 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:53.001793 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-3e914595-b371-47b3-a768-645b444cca2b tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:53.002882 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-3e914595-b371-47b3-a768-645b444cca2b tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:53.007475 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-cdf407b7-f2dd-4c10-ba2b-01e1224c842d req-cab490a6-094f-4b2f-94e3-83dde606f452 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dac8aacd-66be-4695-a513-af3d837d9d47", "name": "network-vif-unplugged", "status": "completed", "tag": "87a044f4-f2f0-463e-a8fe-5c096420eb0e"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:31:53.010077 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3e914595-b371-47b3-a768-645b444cca2b tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:53.011002 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3e914595-b371-47b3-a768-645b444cca2b tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:53.012164 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3e914595-b371-47b3-a768-645b444cca2b tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:53.012748 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3e914595-b371-47b3-a768-645b444cca2b tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:53.017766 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-cdf407b7-f2dd-4c10-ba2b-01e1224c842d req-cab490a6-094f-4b2f-94e3-83dde606f452 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:53.018327 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-cdf407b7-f2dd-4c10-ba2b-01e1224c842d req-cab490a6-094f-4b2f-94e3-83dde606f452 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:53.041036 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.compute.server_external_events [req-cdf407b7-f2dd-4c10-ba2b-01e1224c842d req-cab490a6-094f-4b2f-94e3-83dde606f452 service nova] Creating event network-vif-unplugged:87a044f4-f2f0-463e-a8fe-5c096420eb0e for instance dac8aacd-66be-4695-a513-af3d837d9d47 on hv-cinder-80378 Jun 30 18:31:53.047008 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-cdf407b7-f2dd-4c10-ba2b-01e1224c842d req-cab490a6-094f-4b2f-94e3-83dde606f452 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042999 Jun 30 18:31:53.048625 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 248/490] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:31:53.209056 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-3e914595-b371-47b3-a768-645b444cca2b tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:53.216467 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-3e914595-b371-47b3-a768-645b444cca2b tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 200 len: 1497 microversion: 2.1 time: 0.219496 Jun 30 18:31:53.217243 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 243/491] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:52 2022] GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 1497 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:53.245604 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-d88e7ef0-bd35-420c-9bb6-e70db6559ebe tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:53.247729 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-d88e7ef0-bd35-420c-9bb6-e70db6559ebe tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:53.256643 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d88e7ef0-bd35-420c-9bb6-e70db6559ebe tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:53.257100 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d88e7ef0-bd35-420c-9bb6-e70db6559ebe tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:53.258189 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d88e7ef0-bd35-420c-9bb6-e70db6559ebe tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:53.258645 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d88e7ef0-bd35-420c-9bb6-e70db6559ebe tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:53.285844 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell1:SELECT=100 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:31:53.387608 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-d88e7ef0-bd35-420c-9bb6-e70db6559ebe tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:53.397010 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-d88e7ef0-bd35-420c-9bb6-e70db6559ebe tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1273 microversion: 2.1 time: 0.159739 Jun 30 18:31:53.397854 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 249/492] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:53 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1273 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:53.885955 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-1dce8a86-23f2-4966-bc53-fd3745d596d9 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:53.886451 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-1dce8a86-23f2-4966-bc53-fd3745d596d9 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:53.895563 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-1dce8a86-23f2-4966-bc53-fd3745d596d9 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:53.896876 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-1dce8a86-23f2-4966-bc53-fd3745d596d9 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:53.898591 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-1dce8a86-23f2-4966-bc53-fd3745d596d9 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:53.899778 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-1dce8a86-23f2-4966-bc53-fd3745d596d9 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:53.933834 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-1dce8a86-23f2-4966-bc53-fd3745d596d9 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Going to try to terminate instance {{(pid=117940) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 18:31:53.953615 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:31:53.965848 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-cd046352-6803-40b1-9e20-1572fe72e303 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:53.974005 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-cd046352-6803-40b1-9e20-1572fe72e303 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: dac8aacd-66be-4695-a513-af3d837d9d47] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:53.986586 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-cd046352-6803-40b1-9e20-1572fe72e303 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:53.987410 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-cd046352-6803-40b1-9e20-1572fe72e303 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:53.988402 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-cd046352-6803-40b1-9e20-1572fe72e303 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:53.989050 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-cd046352-6803-40b1-9e20-1572fe72e303 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:54.045982 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-1dce8a86-23f2-4966-bc53-fd3745d596d9 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 204 len: 0 microversion: 2.1 time: 0.162768 Jun 30 18:31:54.048219 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 244/493] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 30 18:31:53 2022] DELETE /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 18:31:54.054069 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [req-d72d85c7-4a7d-467e-b8a2-aff5dc3191a0 req-59e37d7d-7b61-4c41-aabc-0b6e68aaa131 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dac8aacd-66be-4695-a513-af3d837d9d47", "name": "network-vif-deleted", "tag": "87a044f4-f2f0-463e-a8fe-5c096420eb0e"}]} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:31:54.067793 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-d72d85c7-4a7d-467e-b8a2-aff5dc3191a0 req-59e37d7d-7b61-4c41-aabc-0b6e68aaa131 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:54.068941 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-d72d85c7-4a7d-467e-b8a2-aff5dc3191a0 req-59e37d7d-7b61-4c41-aabc-0b6e68aaa131 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:54.084751 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.compute.server_external_events [req-d72d85c7-4a7d-467e-b8a2-aff5dc3191a0 req-59e37d7d-7b61-4c41-aabc-0b6e68aaa131 service nova] Creating event network-vif-deleted:87a044f4-f2f0-463e-a8fe-5c096420eb0e for instance dac8aacd-66be-4695-a513-af3d837d9d47 on hv-cinder-80378 Jun 30 18:31:54.090023 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [req-d72d85c7-4a7d-467e-b8a2-aff5dc3191a0 req-59e37d7d-7b61-4c41-aabc-0b6e68aaa131 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040314 Jun 30 18:31:54.090752 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 245/494] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:31:54.096893 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-bbaa796f-ec6c-474e-b189-ec8705761e03 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:54.098005 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-bbaa796f-ec6c-474e-b189-ec8705761e03 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:54.105934 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-cd046352-6803-40b1-9e20-1572fe72e303 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:54.109915 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-bbaa796f-ec6c-474e-b189-ec8705761e03 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:54.110879 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-bbaa796f-ec6c-474e-b189-ec8705761e03 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:54.112182 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-bbaa796f-ec6c-474e-b189-ec8705761e03 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:54.112621 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-bbaa796f-ec6c-474e-b189-ec8705761e03 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:54.117308 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-cd046352-6803-40b1-9e20-1572fe72e303 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47" status: 200 len: 1472 microversion: 2.1 time: 0.155380 Jun 30 18:31:54.118049 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 250/495] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:53 2022] GET /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47 => generated 1472 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:31:54.257884 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-bbaa796f-ec6c-474e-b189-ec8705761e03 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:54.267888 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-bbaa796f-ec6c-474e-b189-ec8705761e03 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 200 len: 1503 microversion: 2.1 time: 0.175646 Jun 30 18:31:54.268534 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 246/496] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:54 2022] GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 1503 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:54.415195 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-ebbba639-270f-4fc2-8113-b2c63f0e30cf tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:54.415923 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-ebbba639-270f-4fc2-8113-b2c63f0e30cf tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:54.421982 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ebbba639-270f-4fc2-8113-b2c63f0e30cf tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:54.422511 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ebbba639-270f-4fc2-8113-b2c63f0e30cf tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:54.423359 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ebbba639-270f-4fc2-8113-b2c63f0e30cf tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:54.423795 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ebbba639-270f-4fc2-8113-b2c63f0e30cf tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:54.559004 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-ebbba639-270f-4fc2-8113-b2c63f0e30cf tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:54.566938 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-ebbba639-270f-4fc2-8113-b2c63f0e30cf tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1315 microversion: 2.1 time: 0.155691 Jun 30 18:31:54.567589 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 251/497] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:54 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:54.888710 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [req-3a40ce2f-69ac-4107-8a95-025463cacc9a req-5c856811-62e8-49ae-a79f-0d5fa0782fa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "319026da-aa9f-4e14-b11e-7dd9e8282964", "tag": "6a3d1631-84c7-4bb2-93fc-29048e75fe02"}]} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:31:54.896798 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-3a40ce2f-69ac-4107-8a95-025463cacc9a req-5c856811-62e8-49ae-a79f-0d5fa0782fa0 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:54.897237 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-3a40ce2f-69ac-4107-8a95-025463cacc9a req-5c856811-62e8-49ae-a79f-0d5fa0782fa0 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:54.910221 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.compute.server_external_events [req-3a40ce2f-69ac-4107-8a95-025463cacc9a req-5c856811-62e8-49ae-a79f-0d5fa0782fa0 service nova] Creating event network-changed:6a3d1631-84c7-4bb2-93fc-29048e75fe02 for instance 319026da-aa9f-4e14-b11e-7dd9e8282964 on hv-cinder-80378 Jun 30 18:31:54.915674 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [req-3a40ce2f-69ac-4107-8a95-025463cacc9a req-5c856811-62e8-49ae-a79f-0d5fa0782fa0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030486 Jun 30 18:31:54.916283 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 247/498] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:31:55.048387 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:31:55.048867 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Thu Jun 30 18:31:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:31:55.134429 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-7965b023-cfa8-4d62-acc5-4afefac5ff2c tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:55.135069 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-7965b023-cfa8-4d62-acc5-4afefac5ff2c tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: dac8aacd-66be-4695-a513-af3d837d9d47] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:55.142546 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7965b023-cfa8-4d62-acc5-4afefac5ff2c tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:55.142994 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7965b023-cfa8-4d62-acc5-4afefac5ff2c tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:55.143750 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7965b023-cfa8-4d62-acc5-4afefac5ff2c tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:55.144182 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7965b023-cfa8-4d62-acc5-4afefac5ff2c tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:55.205745 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-7965b023-cfa8-4d62-acc5-4afefac5ff2c tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:55.213335 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-7965b023-cfa8-4d62-acc5-4afefac5ff2c tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47" status: 200 len: 1303 microversion: 2.1 time: 0.082746 Jun 30 18:31:55.214319 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 252/499] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:55 2022] GET /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47 => generated 1303 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:55.286986 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-a9fc7958-1ade-46b0-96e3-9878c6960868 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:55.287671 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-a9fc7958-1ade-46b0-96e3-9878c6960868 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:55.294501 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a9fc7958-1ade-46b0-96e3-9878c6960868 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:55.294939 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a9fc7958-1ade-46b0-96e3-9878c6960868 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:55.295676 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a9fc7958-1ade-46b0-96e3-9878c6960868 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:55.296097 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a9fc7958-1ade-46b0-96e3-9878c6960868 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:55.424523 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-a9fc7958-1ade-46b0-96e3-9878c6960868 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:55.431729 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-a9fc7958-1ade-46b0-96e3-9878c6960868 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 200 len: 1503 microversion: 2.1 time: 0.150279 Jun 30 18:31:55.432285 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 248/500] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:55 2022] GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:55.583612 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-2a5f5ab8-7cea-465e-9370-6edf5c400374 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:55.584231 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-2a5f5ab8-7cea-465e-9370-6edf5c400374 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:55.590071 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2a5f5ab8-7cea-465e-9370-6edf5c400374 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:55.590508 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2a5f5ab8-7cea-465e-9370-6edf5c400374 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:55.591246 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2a5f5ab8-7cea-465e-9370-6edf5c400374 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:55.591669 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2a5f5ab8-7cea-465e-9370-6edf5c400374 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:55.725312 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-2a5f5ab8-7cea-465e-9370-6edf5c400374 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:55.732583 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-2a5f5ab8-7cea-465e-9370-6edf5c400374 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1315 microversion: 2.1 time: 0.153433 Jun 30 18:31:55.733132 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 253/501] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:55 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:56.230992 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-ec622556-acbe-4a42-8949-d0e3d2530958 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:56.231512 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-ec622556-acbe-4a42-8949-d0e3d2530958 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: dac8aacd-66be-4695-a513-af3d837d9d47] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:56.237515 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ec622556-acbe-4a42-8949-d0e3d2530958 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:56.237988 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ec622556-acbe-4a42-8949-d0e3d2530958 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:56.238739 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ec622556-acbe-4a42-8949-d0e3d2530958 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:56.239167 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ec622556-acbe-4a42-8949-d0e3d2530958 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:56.269008 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ec622556-acbe-4a42-8949-d0e3d2530958 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:56.269449 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ec622556-acbe-4a42-8949-d0e3d2530958 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:56.269924 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.objects.instance [None req-ec622556-acbe-4a42-8949-d0e3d2530958 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lazy-loading 'fault' on Instance uuid dac8aacd-66be-4695-a513-af3d837d9d47 {{(pid=117940) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 18:31:56.315358 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-ec622556-acbe-4a42-8949-d0e3d2530958 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:56.322989 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-ec622556-acbe-4a42-8949-d0e3d2530958 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47" status: 200 len: 1308 microversion: 2.1 time: 0.096092 Jun 30 18:31:56.323548 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 249/502] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:56 2022] GET /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47 => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:56.449362 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-387cdc1a-17ba-4201-aebd-b4f16f3c58bb tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:56.450998 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-387cdc1a-17ba-4201-aebd-b4f16f3c58bb tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:56.459696 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-387cdc1a-17ba-4201-aebd-b4f16f3c58bb tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:56.460297 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-387cdc1a-17ba-4201-aebd-b4f16f3c58bb tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:56.461608 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-387cdc1a-17ba-4201-aebd-b4f16f3c58bb tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:56.462400 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-387cdc1a-17ba-4201-aebd-b4f16f3c58bb tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:56.690915 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-387cdc1a-17ba-4201-aebd-b4f16f3c58bb tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:56.710863 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-387cdc1a-17ba-4201-aebd-b4f16f3c58bb tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 200 len: 1503 microversion: 2.1 time: 0.265985 Jun 30 18:31:56.713658 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 254/503] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:56 2022] GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 1503 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:56.753473 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-d06e24c5-cc42-4dcc-af42-5ebcffa21e1a tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:56.754146 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-d06e24c5-cc42-4dcc-af42-5ebcffa21e1a tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:56.760321 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d06e24c5-cc42-4dcc-af42-5ebcffa21e1a tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:56.760925 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d06e24c5-cc42-4dcc-af42-5ebcffa21e1a tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:56.761882 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d06e24c5-cc42-4dcc-af42-5ebcffa21e1a tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:56.762459 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d06e24c5-cc42-4dcc-af42-5ebcffa21e1a tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:56.972878 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-d06e24c5-cc42-4dcc-af42-5ebcffa21e1a tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:56.981145 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-d06e24c5-cc42-4dcc-af42-5ebcffa21e1a tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1315 microversion: 2.1 time: 0.231490 Jun 30 18:31:56.981740 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 250/504] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:56 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:57.024877 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-0a31a1cd-dc87-4971-9b47-8e48cec7bde4 req-70e6d8ed-fc2d-4b9b-afa2-ca2232f53e87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a80fcde-066f-4051-b6a4-a49d064fce37", "name": "network-vif-deleted", "tag": "018f0291-f685-44ed-acfe-67b0f47eeaa5"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:31:57.033939 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-0a31a1cd-dc87-4971-9b47-8e48cec7bde4 req-70e6d8ed-fc2d-4b9b-afa2-ca2232f53e87 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:57.034408 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-0a31a1cd-dc87-4971-9b47-8e48cec7bde4 req-70e6d8ed-fc2d-4b9b-afa2-ca2232f53e87 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:57.045459 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.compute.server_external_events [req-0a31a1cd-dc87-4971-9b47-8e48cec7bde4 req-70e6d8ed-fc2d-4b9b-afa2-ca2232f53e87 service nova] Creating event network-vif-deleted:018f0291-f685-44ed-acfe-67b0f47eeaa5 for instance 0a80fcde-066f-4051-b6a4-a49d064fce37 on hv-cinder-80378 Jun 30 18:31:57.051086 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-0a31a1cd-dc87-4971-9b47-8e48cec7bde4 req-70e6d8ed-fc2d-4b9b-afa2-ca2232f53e87 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029980 Jun 30 18:31:57.051654 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 255/505] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:31:57.340645 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-068143e8-7a98-412f-b7e7-82976b50a0d5 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:57.341155 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-068143e8-7a98-412f-b7e7-82976b50a0d5 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: dac8aacd-66be-4695-a513-af3d837d9d47] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:57.348286 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-068143e8-7a98-412f-b7e7-82976b50a0d5 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:57.348735 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-068143e8-7a98-412f-b7e7-82976b50a0d5 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:57.349540 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-068143e8-7a98-412f-b7e7-82976b50a0d5 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:57.349973 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-068143e8-7a98-412f-b7e7-82976b50a0d5 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:57.363771 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.wsgi [None req-068143e8-7a98-412f-b7e7-82976b50a0d5 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] HTTP exception thrown: Instance dac8aacd-66be-4695-a513-af3d837d9d47 could not be found. Jun 30 18:31:57.365415 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-068143e8-7a98-412f-b7e7-82976b50a0d5 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Request method failure captured: Jun 30 18:31:57.365415 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: request: GET /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47 HTTP/1.1 Jun 30 18:31:57.365415 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept: application/json Jun 30 18:31:57.365415 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept-Encoding: identity Jun 30 18:31:57.365415 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Connection: close Jun 30 18:31:57.365415 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Length: 0 Jun 30 18:31:57.365415 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Type: application/json Jun 30 18:31:57.365415 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Host: 10.222.0.33 Jun 30 18:31:57.365415 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Openstack-System-Scope: None Jun 30 18:31:57.365415 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: User-Agent: python-urllib3/1.26.9 Jun 30 18:31:57.365415 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Auth-Token: gAAAAABiveuPhvTtAi8Alnh2wJj1pK_EsueiuLvXWC2w9eZB9CQIJS-M9hfleuRkRthgt77Iv7ZB0AfcpZ9D6k_ZMIH_kDTt0pPIC9On9oYar9qZ_qZ-Z828iIPnv0hJSWSf6NdDRh7erlUkyXRZmyO2iqydj6oKum1e9Wmt0MeuYbWSJ4Obb40 Jun 30 18:31:57.365415 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Id: None Jun 30 18:31:57.365415 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Name: None Jun 30 18:31:57.365415 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Identity-Status: Confirmed Jun 30 18:31:57.365415 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Is-Admin-Project: True Jun 30 18:31:57.365415 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Id: default Jun 30 18:31:57.365415 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Name: Default Jun 30 18:31:57.365415 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Id: 175743f30d314455a3bead1c50750fbe Jun 30 18:31:57.365415 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Name: tempest-VolumesSnapshotTestJSON-676990064 Jun 30 18:31:57.365415 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Role: reader,member Jun 30 18:31:57.365415 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Roles: reader,member Jun 30 18:31:57.366995 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/175743f30d314455a3bead1c50750fbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_175743f30d314455a3bead1c50750fbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/175743f30d314455a3bead1c50750fbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/175743f30d314455a3bead1c50750fbe"}]}] Jun 30 18:31:57.366995 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant: tempest-VolumesSnapshotTestJSON-676990064 Jun 30 18:31:57.366995 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Id: 175743f30d314455a3bead1c50750fbe Jun 30 18:31:57.366995 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-676990064 Jun 30 18:31:57.366995 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User: tempest-VolumesSnapshotTestJSON-676990064-project Jun 30 18:31:57.366995 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Id: default Jun 30 18:31:57.366995 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Name: Default Jun 30 18:31:57.366995 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Id: 4128f8b7190e455b8dc599a404e3608c Jun 30 18:31:57.366995 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Name: tempest-VolumesSnapshotTestJSON-676990064-project Jun 30 18:31:57.366995 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: method: > Jun 30 18:31:57.366995 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: exception: Instance dac8aacd-66be-4695-a513-af3d837d9d47 could not be found. Jun 30 18:31:57.366995 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: action_args: {'id': 'dac8aacd-66be-4695-a513-af3d837d9d47'} Jun 30 18:31:57.367870 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:31:57.367870 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:31:57.367870 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:31:57.367870 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:31:57.367870 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:31:57.367870 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:31:57.367870 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:31:57.367870 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:31:57.367870 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:31:57.367870 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:31:57.367870 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dac8aacd-66be-4695-a513-af3d837d9d47 could not be found. Jun 30 18:31:57.367870 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:31:57.367870 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:31:57.367870 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:31:57.367870 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:31:57.367870 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:31:57.367870 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:31:57.367870 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:31:57.367870 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:31:57.367870 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:31:57.369342 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:31:57.369342 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:31:57.369342 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:31:57.369342 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:31:57.369342 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:31:57.369342 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:31:57.369342 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:31:57.369342 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dac8aacd-66be-4695-a513-af3d837d9d47 could not be found. Jun 30 18:31:57.369342 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:31:57.369342 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:31:57.369342 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:31:57.369342 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:31:57.369342 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:31:57.369342 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:31:57.369342 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:31:57.369342 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:31:57.369342 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dac8aacd-66be-4695-a513-af3d837d9d47 could not be found. Jun 30 18:31:57.369342 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:31:57.370594 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-068143e8-7a98-412f-b7e7-82976b50a0d5 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Returning 404 to user: Instance dac8aacd-66be-4695-a513-af3d837d9d47 could not be found. {{(pid=117940) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:31:57.370594 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-068143e8-7a98-412f-b7e7-82976b50a0d5 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47" status: 404 len: 111 microversion: 2.1 time: 0.030182 Jun 30 18:31:57.370594 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 251/506] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:57 2022] GET /compute/v2.1/servers/dac8aacd-66be-4695-a513-af3d837d9d47 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:31:57.731255 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-1575acab-a2da-4b00-8cff-2fc320ecfaae tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:57.731946 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-1575acab-a2da-4b00-8cff-2fc320ecfaae tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:57.738264 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1575acab-a2da-4b00-8cff-2fc320ecfaae tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:57.738706 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1575acab-a2da-4b00-8cff-2fc320ecfaae tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:57.739457 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1575acab-a2da-4b00-8cff-2fc320ecfaae tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:57.739882 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1575acab-a2da-4b00-8cff-2fc320ecfaae tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:57.806524 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-1575acab-a2da-4b00-8cff-2fc320ecfaae tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:57.814214 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-1575acab-a2da-4b00-8cff-2fc320ecfaae tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 200 len: 1461 microversion: 2.1 time: 0.087650 Jun 30 18:31:57.814770 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 256/507] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:57 2022] GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 1461 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:31:57.998471 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-42db21f3-0123-4c09-9091-f4b609ff5347 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:57.999031 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-42db21f3-0123-4c09-9091-f4b609ff5347 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:58.005751 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-42db21f3-0123-4c09-9091-f4b609ff5347 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:58.006196 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-42db21f3-0123-4c09-9091-f4b609ff5347 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:58.006953 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-42db21f3-0123-4c09-9091-f4b609ff5347 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:58.007386 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-42db21f3-0123-4c09-9091-f4b609ff5347 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:58.137171 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-42db21f3-0123-4c09-9091-f4b609ff5347 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:58.145166 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-42db21f3-0123-4c09-9091-f4b609ff5347 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1315 microversion: 2.1 time: 0.150583 Jun 30 18:31:58.145754 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 252/508] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:57 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:58.831450 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-308bc1b5-33b6-4c9b-86f2-610d64411309 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:58.831987 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-308bc1b5-33b6-4c9b-86f2-610d64411309 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:58.838471 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-308bc1b5-33b6-4c9b-86f2-610d64411309 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:58.838910 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-308bc1b5-33b6-4c9b-86f2-610d64411309 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:58.839667 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-308bc1b5-33b6-4c9b-86f2-610d64411309 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:58.840096 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-308bc1b5-33b6-4c9b-86f2-610d64411309 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:58.910422 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-308bc1b5-33b6-4c9b-86f2-610d64411309 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:58.917745 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-308bc1b5-33b6-4c9b-86f2-610d64411309 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 200 len: 1461 microversion: 2.1 time: 0.090438 Jun 30 18:31:58.918306 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 257/509] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:58 2022] GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 1461 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:59.162843 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-73965475-07b4-4850-8a16-762b27fd29dd tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:59.163455 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-73965475-07b4-4850-8a16-762b27fd29dd tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:59.170036 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-73965475-07b4-4850-8a16-762b27fd29dd tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:59.170484 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-73965475-07b4-4850-8a16-762b27fd29dd tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:59.171236 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-73965475-07b4-4850-8a16-762b27fd29dd tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:59.171673 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-73965475-07b4-4850-8a16-762b27fd29dd tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:59.301091 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-73965475-07b4-4850-8a16-762b27fd29dd tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:31:59.308431 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-73965475-07b4-4850-8a16-762b27fd29dd tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1315 microversion: 2.1 time: 0.149598 Jun 30 18:31:59.308996 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 253/510] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:59 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:59.935540 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-7f49c1c6-ef52-4c45-bfae-bd0e12549492 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:31:59.936146 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-7f49c1c6-ef52-4c45-bfae-bd0e12549492 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:31:59.943295 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7f49c1c6-ef52-4c45-bfae-bd0e12549492 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:59.943739 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7f49c1c6-ef52-4c45-bfae-bd0e12549492 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:31:59.944490 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7f49c1c6-ef52-4c45-bfae-bd0e12549492 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:31:59.945192 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7f49c1c6-ef52-4c45-bfae-bd0e12549492 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:00.009821 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-7f49c1c6-ef52-4c45-bfae-bd0e12549492 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:00.017359 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-7f49c1c6-ef52-4c45-bfae-bd0e12549492 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 200 len: 1461 microversion: 2.1 time: 0.085576 Jun 30 18:32:00.017953 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 258/511] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:31:59 2022] GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 1461 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:00.326437 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-46164d62-a2b6-4fa1-a137-8d1806d617e6 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:00.327034 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-46164d62-a2b6-4fa1-a137-8d1806d617e6 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:00.333485 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-46164d62-a2b6-4fa1-a137-8d1806d617e6 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:00.333958 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-46164d62-a2b6-4fa1-a137-8d1806d617e6 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:00.334716 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-46164d62-a2b6-4fa1-a137-8d1806d617e6 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:00.335141 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-46164d62-a2b6-4fa1-a137-8d1806d617e6 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:00.465560 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-46164d62-a2b6-4fa1-a137-8d1806d617e6 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:00.473645 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-46164d62-a2b6-4fa1-a137-8d1806d617e6 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1315 microversion: 2.1 time: 0.151047 Jun 30 18:32:00.474204 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 254/512] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:00 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:01.034820 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-b193c565-f9c0-4bf0-b487-1d20c758cd80 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:01.035421 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-b193c565-f9c0-4bf0-b487-1d20c758cd80 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:01.041910 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b193c565-f9c0-4bf0-b487-1d20c758cd80 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:01.042344 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b193c565-f9c0-4bf0-b487-1d20c758cd80 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:01.043103 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b193c565-f9c0-4bf0-b487-1d20c758cd80 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:01.043529 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b193c565-f9c0-4bf0-b487-1d20c758cd80 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:01.107920 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-b193c565-f9c0-4bf0-b487-1d20c758cd80 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:01.116679 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-b193c565-f9c0-4bf0-b487-1d20c758cd80 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 200 len: 1461 microversion: 2.1 time: 0.086191 Jun 30 18:32:01.117239 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 259/513] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:01 2022] GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 1461 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:01.490251 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-c3764d8b-ca0b-44e1-abb5-d09421a616af tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:01.490834 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-c3764d8b-ca0b-44e1-abb5-d09421a616af tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:01.497246 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c3764d8b-ca0b-44e1-abb5-d09421a616af tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:01.497715 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c3764d8b-ca0b-44e1-abb5-d09421a616af tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:01.498464 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c3764d8b-ca0b-44e1-abb5-d09421a616af tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:01.498893 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c3764d8b-ca0b-44e1-abb5-d09421a616af tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:01.623771 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-c3764d8b-ca0b-44e1-abb5-d09421a616af tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:01.631078 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-c3764d8b-ca0b-44e1-abb5-d09421a616af tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1315 microversion: 2.1 time: 0.144640 Jun 30 18:32:01.631638 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 255/514] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:01 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:32:02.133393 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-6effcb6d-163a-4ba1-a608-1e302ae4bb24 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:02.134084 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-6effcb6d-163a-4ba1-a608-1e302ae4bb24 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:02.140519 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6effcb6d-163a-4ba1-a608-1e302ae4bb24 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:02.140982 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6effcb6d-163a-4ba1-a608-1e302ae4bb24 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:02.141851 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6effcb6d-163a-4ba1-a608-1e302ae4bb24 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:02.142468 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6effcb6d-163a-4ba1-a608-1e302ae4bb24 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:02.205115 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-6effcb6d-163a-4ba1-a608-1e302ae4bb24 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:02.212557 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-6effcb6d-163a-4ba1-a608-1e302ae4bb24 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 200 len: 1461 microversion: 2.1 time: 0.082971 Jun 30 18:32:02.213117 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 260/515] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:02 2022] GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 1461 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:02.648779 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-cac0ee90-aaf0-49d4-b527-f68123e8a9e2 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:02.649307 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-cac0ee90-aaf0-49d4-b527-f68123e8a9e2 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:02.655747 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cac0ee90-aaf0-49d4-b527-f68123e8a9e2 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:02.656193 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cac0ee90-aaf0-49d4-b527-f68123e8a9e2 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:02.657024 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cac0ee90-aaf0-49d4-b527-f68123e8a9e2 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:02.657741 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cac0ee90-aaf0-49d4-b527-f68123e8a9e2 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:02.794972 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-cac0ee90-aaf0-49d4-b527-f68123e8a9e2 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:02.802509 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-cac0ee90-aaf0-49d4-b527-f68123e8a9e2 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1315 microversion: 2.1 time: 0.157702 Jun 30 18:32:02.803072 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 256/516] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:02 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:03.228641 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-b29ae702-42b1-4161-b23c-86cec24c5677 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:03.229318 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-b29ae702-42b1-4161-b23c-86cec24c5677 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:03.236898 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b29ae702-42b1-4161-b23c-86cec24c5677 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:03.237390 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b29ae702-42b1-4161-b23c-86cec24c5677 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:03.238228 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b29ae702-42b1-4161-b23c-86cec24c5677 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:03.238757 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b29ae702-42b1-4161-b23c-86cec24c5677 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:03.300667 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-b29ae702-42b1-4161-b23c-86cec24c5677 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:03.308095 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-b29ae702-42b1-4161-b23c-86cec24c5677 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 200 len: 1461 microversion: 2.1 time: 0.083315 Jun 30 18:32:03.308659 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 261/517] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:03 2022] GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 1461 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:03.819427 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-660b2dde-e965-44a5-9fa4-913d6ff01368 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:03.820298 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-660b2dde-e965-44a5-9fa4-913d6ff01368 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:03.826656 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-660b2dde-e965-44a5-9fa4-913d6ff01368 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:03.827093 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-660b2dde-e965-44a5-9fa4-913d6ff01368 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:03.827834 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-660b2dde-e965-44a5-9fa4-913d6ff01368 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:03.828257 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-660b2dde-e965-44a5-9fa4-913d6ff01368 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:03.962155 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-660b2dde-e965-44a5-9fa4-913d6ff01368 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:03.969381 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-660b2dde-e965-44a5-9fa4-913d6ff01368 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1315 microversion: 2.1 time: 0.153778 Jun 30 18:32:03.970031 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 257/518] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:03 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:04.324646 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-cd22546b-f8df-4df5-9a69-94fb896b5e87 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:04.325241 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-cd22546b-f8df-4df5-9a69-94fb896b5e87 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:04.331957 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-cd22546b-f8df-4df5-9a69-94fb896b5e87 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:04.332300 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-cd22546b-f8df-4df5-9a69-94fb896b5e87 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:04.333745 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-cd22546b-f8df-4df5-9a69-94fb896b5e87 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:04.334192 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-cd22546b-f8df-4df5-9a69-94fb896b5e87 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:04.410481 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-cd22546b-f8df-4df5-9a69-94fb896b5e87 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:04.417793 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-cd22546b-f8df-4df5-9a69-94fb896b5e87 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 200 len: 1461 microversion: 2.1 time: 0.097479 Jun 30 18:32:04.418364 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 262/519] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:04 2022] GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 1461 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:04.987526 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-ca5d0612-47db-4852-82ac-160b19a0320b tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:04.988068 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-ca5d0612-47db-4852-82ac-160b19a0320b tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:04.994436 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ca5d0612-47db-4852-82ac-160b19a0320b tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:04.994874 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ca5d0612-47db-4852-82ac-160b19a0320b tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:04.995628 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ca5d0612-47db-4852-82ac-160b19a0320b tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:04.996058 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ca5d0612-47db-4852-82ac-160b19a0320b tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:05.130722 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-ca5d0612-47db-4852-82ac-160b19a0320b tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:05.138354 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-ca5d0612-47db-4852-82ac-160b19a0320b tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1315 microversion: 2.1 time: 0.155727 Jun 30 18:32:05.138640 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 258/520] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:04 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:05.436087 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-0bad1568-6642-4295-86a8-1979a5045dc4 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:05.436663 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-0bad1568-6642-4295-86a8-1979a5045dc4 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:05.443706 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0bad1568-6642-4295-86a8-1979a5045dc4 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:05.444138 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0bad1568-6642-4295-86a8-1979a5045dc4 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:05.444878 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0bad1568-6642-4295-86a8-1979a5045dc4 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:05.445568 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0bad1568-6642-4295-86a8-1979a5045dc4 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:05.507785 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-0bad1568-6642-4295-86a8-1979a5045dc4 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:05.515005 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-0bad1568-6642-4295-86a8-1979a5045dc4 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 200 len: 1298 microversion: 2.1 time: 0.082797 Jun 30 18:32:05.515552 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 263/521] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:05 2022] GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 1298 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:06.155345 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-fa7b7cf6-eb1b-4e5e-904e-676488ac5582 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:06.155954 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-fa7b7cf6-eb1b-4e5e-904e-676488ac5582 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:06.162697 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fa7b7cf6-eb1b-4e5e-904e-676488ac5582 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:06.163148 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fa7b7cf6-eb1b-4e5e-904e-676488ac5582 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:06.163897 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fa7b7cf6-eb1b-4e5e-904e-676488ac5582 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:06.164327 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fa7b7cf6-eb1b-4e5e-904e-676488ac5582 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:06.293056 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-fa7b7cf6-eb1b-4e5e-904e-676488ac5582 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:06.301015 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-fa7b7cf6-eb1b-4e5e-904e-676488ac5582 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1315 microversion: 2.1 time: 0.149556 Jun 30 18:32:06.301594 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 259/522] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:06 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:06.531922 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-47d50625-16d4-433a-a110-02a46ef79c56 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:06.533193 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-47d50625-16d4-433a-a110-02a46ef79c56 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:06.539689 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-47d50625-16d4-433a-a110-02a46ef79c56 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:06.540124 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-47d50625-16d4-433a-a110-02a46ef79c56 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:06.540911 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-47d50625-16d4-433a-a110-02a46ef79c56 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:06.541283 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-47d50625-16d4-433a-a110-02a46ef79c56 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:06.572353 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-47d50625-16d4-433a-a110-02a46ef79c56 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:06.572791 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-47d50625-16d4-433a-a110-02a46ef79c56 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:06.573232 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.objects.instance [None req-47d50625-16d4-433a-a110-02a46ef79c56 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lazy-loading 'fault' on Instance uuid 0a80fcde-066f-4051-b6a4-a49d064fce37 {{(pid=117941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 18:32:06.613797 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-47d50625-16d4-433a-a110-02a46ef79c56 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:06.621032 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-47d50625-16d4-433a-a110-02a46ef79c56 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 200 len: 1303 microversion: 2.1 time: 0.092923 Jun 30 18:32:06.621615 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 264/523] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:06 2022] GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 1303 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:07.318215 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-5c13cdd8-9152-4c8a-abcb-f431c0a49a37 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:07.318756 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-5c13cdd8-9152-4c8a-abcb-f431c0a49a37 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:07.321417 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:32:07.326671 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5c13cdd8-9152-4c8a-abcb-f431c0a49a37 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:07.327116 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5c13cdd8-9152-4c8a-abcb-f431c0a49a37 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:07.327872 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5c13cdd8-9152-4c8a-abcb-f431c0a49a37 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:07.328303 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5c13cdd8-9152-4c8a-abcb-f431c0a49a37 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:07.459448 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-5c13cdd8-9152-4c8a-abcb-f431c0a49a37 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:07.466836 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-5c13cdd8-9152-4c8a-abcb-f431c0a49a37 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1315 microversion: 2.1 time: 0.153088 Jun 30 18:32:07.467400 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 260/524] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:07 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:07.638991 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-3087a71d-4188-4c23-a80f-091f1c8fe345 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:07.639589 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-3087a71d-4188-4c23-a80f-091f1c8fe345 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:07.645735 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3087a71d-4188-4c23-a80f-091f1c8fe345 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:07.646168 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3087a71d-4188-4c23-a80f-091f1c8fe345 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:07.646930 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3087a71d-4188-4c23-a80f-091f1c8fe345 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:07.647349 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3087a71d-4188-4c23-a80f-091f1c8fe345 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:07.677241 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3087a71d-4188-4c23-a80f-091f1c8fe345 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:07.677698 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3087a71d-4188-4c23-a80f-091f1c8fe345 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:07.678131 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.objects.instance [None req-3087a71d-4188-4c23-a80f-091f1c8fe345 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lazy-loading 'fault' on Instance uuid 0a80fcde-066f-4051-b6a4-a49d064fce37 {{(pid=117941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 18:32:07.720536 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-3087a71d-4188-4c23-a80f-091f1c8fe345 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:07.728587 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-3087a71d-4188-4c23-a80f-091f1c8fe345 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 200 len: 1303 microversion: 2.1 time: 0.093432 Jun 30 18:32:07.729151 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 265/525] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:07 2022] GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 1303 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:08.483913 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-9a707071-10e6-4607-88e9-ad15e4d1649c tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:08.484519 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-9a707071-10e6-4607-88e9-ad15e4d1649c tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:08.491479 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9a707071-10e6-4607-88e9-ad15e4d1649c tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:08.491949 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9a707071-10e6-4607-88e9-ad15e4d1649c tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:08.492696 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9a707071-10e6-4607-88e9-ad15e4d1649c tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:08.493126 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9a707071-10e6-4607-88e9-ad15e4d1649c tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:08.623220 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-9a707071-10e6-4607-88e9-ad15e4d1649c tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:08.626542 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:32:08.633526 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-9a707071-10e6-4607-88e9-ad15e4d1649c tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1315 microversion: 2.1 time: 0.153481 Jun 30 18:32:08.634124 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 261/526] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:08 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:08.745837 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-a975b7fb-947f-4dac-a6f4-c28205bd6dab tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:08.746444 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-a975b7fb-947f-4dac-a6f4-c28205bd6dab tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:08.753215 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a975b7fb-947f-4dac-a6f4-c28205bd6dab tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:08.753703 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a975b7fb-947f-4dac-a6f4-c28205bd6dab tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:08.754450 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a975b7fb-947f-4dac-a6f4-c28205bd6dab tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:08.754874 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a975b7fb-947f-4dac-a6f4-c28205bd6dab tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:08.759019 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell1:SELECT=100 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:32:08.785724 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a975b7fb-947f-4dac-a6f4-c28205bd6dab tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:08.786157 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a975b7fb-947f-4dac-a6f4-c28205bd6dab tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:08.786589 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.objects.instance [None req-a975b7fb-947f-4dac-a6f4-c28205bd6dab tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lazy-loading 'fault' on Instance uuid 0a80fcde-066f-4051-b6a4-a49d064fce37 {{(pid=117941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 18:32:08.826992 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-a975b7fb-947f-4dac-a6f4-c28205bd6dab tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:08.834874 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-a975b7fb-947f-4dac-a6f4-c28205bd6dab tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 200 len: 1303 microversion: 2.1 time: 0.092986 Jun 30 18:32:08.835427 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 266/527] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:08 2022] GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 1303 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:09.316842 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-cb9aecf2-d350-44b4-88a1-9c7a0c795e8c tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-59414984", "imageRef": "636d6d52-5033-47e1-bf75-0b4fc50c0bb0", "flavorRef": "452", "networks": [{"uuid": "18db706b-0736-4d9b-9de7-81f0382d8993"}]}} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:32:09.367247 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.network.neutron [None req-cb9aecf2-d350-44b4-88a1-9c7a0c795e8c tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] validate_networks() for [('18db706b-0736-4d9b-9de7-81f0382d8993', None, None, None, None, None)] {{(pid=117940) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 18:32:09.650864 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-2d735e88-9326-439c-b469-c1ba95769883 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:09.652081 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-2d735e88-9326-439c-b469-c1ba95769883 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:09.658289 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2d735e88-9326-439c-b469-c1ba95769883 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:09.658727 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2d735e88-9326-439c-b469-c1ba95769883 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:09.659688 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2d735e88-9326-439c-b469-c1ba95769883 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:09.660115 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2d735e88-9326-439c-b469-c1ba95769883 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:10.004059 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-2d735e88-9326-439c-b469-c1ba95769883 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:10.011359 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-2d735e88-9326-439c-b469-c1ba95769883 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1315 microversion: 2.1 time: 0.364471 Jun 30 18:32:10.011920 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 267/528] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:09 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1315 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:32:10.022054 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-4617d06a-2535-4c14-886a-5d6cc0c21ba7 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:10.022653 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-4617d06a-2535-4c14-886a-5d6cc0c21ba7 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:10.028733 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-4617d06a-2535-4c14-886a-5d6cc0c21ba7 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:10.029190 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-4617d06a-2535-4c14-886a-5d6cc0c21ba7 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:10.029984 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-4617d06a-2535-4c14-886a-5d6cc0c21ba7 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:10.030416 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-4617d06a-2535-4c14-886a-5d6cc0c21ba7 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:10.034018 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-cb9aecf2-d350-44b4-88a1-9c7a0c795e8c tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Flavor limits 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 18:32:10.034425 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-cb9aecf2-d350-44b4-88a1-9c7a0c795e8c tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Image limits 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 18:32:10.034881 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-cb9aecf2-d350-44b4-88a1-9c7a0c795e8c tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Flavor pref 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 18:32:10.035279 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-cb9aecf2-d350-44b4-88a1-9c7a0c795e8c tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Image pref 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 18:32:10.035678 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-cb9aecf2-d350-44b4-88a1-9c7a0c795e8c tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 18:32:10.045130 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cb9aecf2-d350-44b4-88a1-9c7a0c795e8c tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:10.045569 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cb9aecf2-d350-44b4-88a1-9c7a0c795e8c tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:10.046373 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cb9aecf2-d350-44b4-88a1-9c7a0c795e8c tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:10.046799 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cb9aecf2-d350-44b4-88a1-9c7a0c795e8c tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:10.060773 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-4617d06a-2535-4c14-886a-5d6cc0c21ba7 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:10.061220 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-4617d06a-2535-4c14-886a-5d6cc0c21ba7 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:10.061692 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.objects.instance [None req-4617d06a-2535-4c14-886a-5d6cc0c21ba7 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lazy-loading 'fault' on Instance uuid 0a80fcde-066f-4051-b6a4-a49d064fce37 {{(pid=117941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 18:32:10.063055 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.quota [None req-cb9aecf2-d350-44b4-88a1-9c7a0c795e8c tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Getting quotas for project 175743f30d314455a3bead1c50750fbe. Resources: {'ram', 'instances', 'cores'} {{(pid=117940) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 18:32:10.068112 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.quota [None req-cb9aecf2-d350-44b4-88a1-9c7a0c795e8c tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Getting quotas for user 4128f8b7190e455b8dc599a404e3608c and project 175743f30d314455a3bead1c50750fbe. Resources: {'ram', 'instances', 'cores'} {{(pid=117940) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 18:32:10.079237 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-cb9aecf2-d350-44b4-88a1-9c7a0c795e8c tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Going to run 1 instances... {{(pid=117940) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 18:32:10.082204 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-cb9aecf2-d350-44b4-88a1-9c7a0c795e8c tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: 19968286-a102-4460-b41d-b98768d61ba4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='636d6d52-5033-47e1-bf75-0b4fc50c0bb0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117940) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 18:32:10.107423 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-4617d06a-2535-4c14-886a-5d6cc0c21ba7 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:10.116355 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-4617d06a-2535-4c14-886a-5d6cc0c21ba7 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 200 len: 1303 microversion: 2.1 time: 0.103424 Jun 30 18:32:10.116957 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 268/529] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:10 2022] GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 1303 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:10.130671 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-cb9aecf2-d350-44b4-88a1-9c7a0c795e8c tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.818272 Jun 30 18:32:10.131309 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 262/530] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 30 18:32:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 18:32:10.141100 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-c8427c7c-f09a-4539-a656-24913ed28ebf tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:10.141670 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-c8427c7c-f09a-4539-a656-24913ed28ebf tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: 19968286-a102-4460-b41d-b98768d61ba4] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:10.195708 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-c8427c7c-f09a-4539-a656-24913ed28ebf tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:10.202313 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-c8427c7c-f09a-4539-a656-24913ed28ebf tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4" status: 200 len: 1217 microversion: 2.1 time: 0.065140 Jun 30 18:32:10.202878 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 269/531] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:10 2022] GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4 => generated 1217 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:11.028718 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-bad7a8f2-8f73-4ed2-97ed-34e5444fbe99 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:11.029332 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-bad7a8f2-8f73-4ed2-97ed-34e5444fbe99 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:11.037358 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-bad7a8f2-8f73-4ed2-97ed-34e5444fbe99 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:11.037943 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-bad7a8f2-8f73-4ed2-97ed-34e5444fbe99 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:11.038589 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-bad7a8f2-8f73-4ed2-97ed-34e5444fbe99 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:11.039022 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-bad7a8f2-8f73-4ed2-97ed-34e5444fbe99 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:11.132114 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-0e1b2c38-7050-4e5a-a9ed-6bab016b8f91 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:11.132807 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-0e1b2c38-7050-4e5a-a9ed-6bab016b8f91 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:11.139382 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0e1b2c38-7050-4e5a-a9ed-6bab016b8f91 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:11.139893 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0e1b2c38-7050-4e5a-a9ed-6bab016b8f91 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:11.140714 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0e1b2c38-7050-4e5a-a9ed-6bab016b8f91 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:11.141144 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0e1b2c38-7050-4e5a-a9ed-6bab016b8f91 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:11.173334 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0e1b2c38-7050-4e5a-a9ed-6bab016b8f91 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:11.173503 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-bad7a8f2-8f73-4ed2-97ed-34e5444fbe99 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:11.173940 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0e1b2c38-7050-4e5a-a9ed-6bab016b8f91 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:11.174666 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.objects.instance [None req-0e1b2c38-7050-4e5a-a9ed-6bab016b8f91 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lazy-loading 'fault' on Instance uuid 0a80fcde-066f-4051-b6a4-a49d064fce37 {{(pid=117941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 18:32:11.181103 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-bad7a8f2-8f73-4ed2-97ed-34e5444fbe99 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1315 microversion: 2.1 time: 0.156760 Jun 30 18:32:11.190064 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 263/532] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:11 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:11.216432 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-0e1b2c38-7050-4e5a-a9ed-6bab016b8f91 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:11.219581 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-e2c2bdc8-9b24-4a65-99e8-0bd7f3065ba0 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:11.220124 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-e2c2bdc8-9b24-4a65-99e8-0bd7f3065ba0 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: 19968286-a102-4460-b41d-b98768d61ba4] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:11.224236 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-0e1b2c38-7050-4e5a-a9ed-6bab016b8f91 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 200 len: 1303 microversion: 2.1 time: 0.095896 Jun 30 18:32:11.224885 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 270/533] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:11 2022] GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:32:11.226275 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e2c2bdc8-9b24-4a65-99e8-0bd7f3065ba0 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:11.226729 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e2c2bdc8-9b24-4a65-99e8-0bd7f3065ba0 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:11.227594 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e2c2bdc8-9b24-4a65-99e8-0bd7f3065ba0 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:11.228023 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e2c2bdc8-9b24-4a65-99e8-0bd7f3065ba0 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:11.291918 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-e2c2bdc8-9b24-4a65-99e8-0bd7f3065ba0 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:11.299745 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-e2c2bdc8-9b24-4a65-99e8-0bd7f3065ba0 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4" status: 200 len: 1221 microversion: 2.1 time: 0.083482 Jun 30 18:32:11.300421 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 264/534] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:11 2022] GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4 => generated 1221 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:32:12.197256 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-1a9752ba-699e-45f8-a4de-d7806c6abba9 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:12.197876 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-1a9752ba-699e-45f8-a4de-d7806c6abba9 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:12.204297 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1a9752ba-699e-45f8-a4de-d7806c6abba9 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:12.204731 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1a9752ba-699e-45f8-a4de-d7806c6abba9 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:12.205467 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1a9752ba-699e-45f8-a4de-d7806c6abba9 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:12.206764 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1a9752ba-699e-45f8-a4de-d7806c6abba9 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:12.241155 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-99d4956b-e23e-42ba-8fb7-ead036aac187 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:12.241793 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-99d4956b-e23e-42ba-8fb7-ead036aac187 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:12.248355 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-99d4956b-e23e-42ba-8fb7-ead036aac187 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:12.248798 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-99d4956b-e23e-42ba-8fb7-ead036aac187 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:12.249557 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-99d4956b-e23e-42ba-8fb7-ead036aac187 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:12.250013 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-99d4956b-e23e-42ba-8fb7-ead036aac187 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:12.283344 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-99d4956b-e23e-42ba-8fb7-ead036aac187 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:12.283534 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-99d4956b-e23e-42ba-8fb7-ead036aac187 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:12.285672 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.objects.instance [None req-99d4956b-e23e-42ba-8fb7-ead036aac187 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lazy-loading 'fault' on Instance uuid 0a80fcde-066f-4051-b6a4-a49d064fce37 {{(pid=117940) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 18:32:12.340972 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-99d4956b-e23e-42ba-8fb7-ead036aac187 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374555cda1b4424894093ebcc51cd651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116a07f168ef45e1b2f4e7a084fba32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:12.348559 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-99d4956b-e23e-42ba-8fb7-ead036aac187 tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 200 len: 1303 microversion: 2.1 time: 0.111490 Jun 30 18:32:12.349137 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 265/535] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:12 2022] GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 1303 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:32:12.353552 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-48edb27e-2c93-4b95-a19c-f52c741d21d2 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:12.354176 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-48edb27e-2c93-4b95-a19c-f52c741d21d2 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: 19968286-a102-4460-b41d-b98768d61ba4] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:12.359887 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-48edb27e-2c93-4b95-a19c-f52c741d21d2 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:12.360333 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-48edb27e-2c93-4b95-a19c-f52c741d21d2 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:12.361096 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-48edb27e-2c93-4b95-a19c-f52c741d21d2 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:12.361527 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-48edb27e-2c93-4b95-a19c-f52c741d21d2 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:12.362025 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-1a9752ba-699e-45f8-a4de-d7806c6abba9 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:12.369476 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-1a9752ba-699e-45f8-a4de-d7806c6abba9 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1315 microversion: 2.1 time: 0.176327 Jun 30 18:32:12.370076 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 271/536] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:12 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:12.422391 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-48edb27e-2c93-4b95-a19c-f52c741d21d2 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:12.430065 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-48edb27e-2c93-4b95-a19c-f52c741d21d2 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4" status: 200 len: 1221 microversion: 2.1 time: 0.079947 Jun 30 18:32:12.430621 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 266/537] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:12 2022] GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4 => generated 1221 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:13.365666 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-56f5857f-c1a1-4f54-b35a-6540f2e006cb tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:13.366219 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-56f5857f-c1a1-4f54-b35a-6540f2e006cb tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] [instance: 0a80fcde-066f-4051-b6a4-a49d064fce37] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:13.372747 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-56f5857f-c1a1-4f54-b35a-6540f2e006cb tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:13.373194 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-56f5857f-c1a1-4f54-b35a-6540f2e006cb tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:13.373976 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-56f5857f-c1a1-4f54-b35a-6540f2e006cb tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:13.374409 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-56f5857f-c1a1-4f54-b35a-6540f2e006cb tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:13.386675 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-19768da7-bce7-4de0-a36d-e1b41376714e tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:13.387277 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-19768da7-bce7-4de0-a36d-e1b41376714e tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:13.387745 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.wsgi [None req-56f5857f-c1a1-4f54-b35a-6540f2e006cb tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] HTTP exception thrown: Instance 0a80fcde-066f-4051-b6a4-a49d064fce37 could not be found. Jun 30 18:32:13.389370 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-56f5857f-c1a1-4f54-b35a-6540f2e006cb tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Request method failure captured: Jun 30 18:32:13.389370 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: request: GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 HTTP/1.1 Jun 30 18:32:13.389370 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept: application/json Jun 30 18:32:13.389370 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept-Encoding: identity Jun 30 18:32:13.389370 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Connection: close Jun 30 18:32:13.389370 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Length: 0 Jun 30 18:32:13.389370 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Type: application/json Jun 30 18:32:13.389370 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Host: 10.222.0.33 Jun 30 18:32:13.389370 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Openstack-System-Scope: None Jun 30 18:32:13.389370 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: User-Agent: python-urllib3/1.26.9 Jun 30 18:32:13.389370 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Auth-Token: gAAAAABivevKSoVwP-ZjmjkKOXjfi-WbD_QehQx5HUMegUP-HXgq3Qv0_pDjElExZS9ZvPkYxOw34n_aS_5q581Tta0St9m27UBc-L9YaepHp1eTHl4Yw_prqTOSUbCyhp2NKWcvLVRG_N6tbhYfNcLeWZ6__NF0IKtSbU43VJxARUCago0Ptyc Jun 30 18:32:13.389370 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Id: None Jun 30 18:32:13.389370 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Name: None Jun 30 18:32:13.389370 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Identity-Status: Confirmed Jun 30 18:32:13.389370 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Is-Admin-Project: True Jun 30 18:32:13.389370 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Id: default Jun 30 18:32:13.389370 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Name: Default Jun 30 18:32:13.389370 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Id: 116a07f168ef45e1b2f4e7a084fba32c Jun 30 18:32:13.389370 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Name: tempest-VolumesActionsTest-1098859793 Jun 30 18:32:13.389370 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Role: reader,member Jun 30 18:32:13.389370 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Roles: reader,member Jun 30 18:32:13.390698 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/116a07f168ef45e1b2f4e7a084fba32c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_116a07f168ef45e1b2f4e7a084fba32c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/116a07f168ef45e1b2f4e7a084fba32c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/116a07f168ef45e1b2f4e7a084fba32c"}]}] Jun 30 18:32:13.390698 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant: tempest-VolumesActionsTest-1098859793 Jun 30 18:32:13.390698 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Id: 116a07f168ef45e1b2f4e7a084fba32c Jun 30 18:32:13.390698 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Name: tempest-VolumesActionsTest-1098859793 Jun 30 18:32:13.390698 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User: tempest-VolumesActionsTest-1098859793-project Jun 30 18:32:13.390698 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Id: default Jun 30 18:32:13.390698 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Name: Default Jun 30 18:32:13.390698 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Id: 374555cda1b4424894093ebcc51cd651 Jun 30 18:32:13.390698 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Name: tempest-VolumesActionsTest-1098859793-project Jun 30 18:32:13.390698 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: method: > Jun 30 18:32:13.390698 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: exception: Instance 0a80fcde-066f-4051-b6a4-a49d064fce37 could not be found. Jun 30 18:32:13.390698 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: action_args: {'id': '0a80fcde-066f-4051-b6a4-a49d064fce37'} Jun 30 18:32:13.391491 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:32:13.391491 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:32:13.391491 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:32:13.391491 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:32:13.391491 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:32:13.391491 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:32:13.391491 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:32:13.391491 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:32:13.391491 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:32:13.391491 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:32:13.391491 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a80fcde-066f-4051-b6a4-a49d064fce37 could not be found. Jun 30 18:32:13.391491 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:32:13.391491 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:32:13.391491 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:32:13.391491 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:32:13.391491 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:32:13.391491 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:32:13.391491 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:32:13.391491 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:32:13.391491 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:32:13.393863 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:32:13.393863 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:32:13.393863 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:32:13.393863 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:32:13.393863 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:32:13.393863 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:32:13.393863 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:32:13.393863 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a80fcde-066f-4051-b6a4-a49d064fce37 could not be found. Jun 30 18:32:13.393863 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:32:13.393863 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:32:13.393863 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:32:13.393863 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:32:13.393863 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:32:13.393863 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:32:13.393863 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:32:13.393863 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:32:13.393863 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a80fcde-066f-4051-b6a4-a49d064fce37 could not be found. Jun 30 18:32:13.393863 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:32:13.394972 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-56f5857f-c1a1-4f54-b35a-6540f2e006cb tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] Returning 404 to user: Instance 0a80fcde-066f-4051-b6a4-a49d064fce37 could not be found. {{(pid=117941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:32:13.394972 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-56f5857f-c1a1-4f54-b35a-6540f2e006cb tempest-VolumesActionsTest-1098859793 tempest-VolumesActionsTest-1098859793-project] 10.222.0.33 "GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37" status: 404 len: 111 microversion: 2.1 time: 0.029321 Jun 30 18:32:13.394972 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 272/538] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:13 2022] GET /compute/v2.1/servers/0a80fcde-066f-4051-b6a4-a49d064fce37 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:32:13.395821 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-19768da7-bce7-4de0-a36d-e1b41376714e tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:13.396363 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-19768da7-bce7-4de0-a36d-e1b41376714e tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:13.397054 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-19768da7-bce7-4de0-a36d-e1b41376714e tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:13.397484 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-19768da7-bce7-4de0-a36d-e1b41376714e tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:13.447491 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-9d1dc360-10fb-4109-8599-a9150e6c3e20 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:13.448101 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-9d1dc360-10fb-4109-8599-a9150e6c3e20 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: 19968286-a102-4460-b41d-b98768d61ba4] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:13.454878 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9d1dc360-10fb-4109-8599-a9150e6c3e20 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:13.455331 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9d1dc360-10fb-4109-8599-a9150e6c3e20 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:13.456780 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9d1dc360-10fb-4109-8599-a9150e6c3e20 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:13.457472 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9d1dc360-10fb-4109-8599-a9150e6c3e20 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:13.540448 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-9d1dc360-10fb-4109-8599-a9150e6c3e20 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:13.548148 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-9d1dc360-10fb-4109-8599-a9150e6c3e20 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4" status: 200 len: 1269 microversion: 2.1 time: 0.104873 Jun 30 18:32:13.548915 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 273/539] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:13 2022] GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4 => generated 1269 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:13.569805 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-19768da7-bce7-4de0-a36d-e1b41376714e tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:13.577612 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-19768da7-bce7-4de0-a36d-e1b41376714e tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1315 microversion: 2.1 time: 0.194773 Jun 30 18:32:13.578179 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 267/540] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:13 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:32:14.567420 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-95a84317-d303-486f-aee4-a3a7d0b9f038 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:14.568492 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-95a84317-d303-486f-aee4-a3a7d0b9f038 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: 19968286-a102-4460-b41d-b98768d61ba4] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:14.575986 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-95a84317-d303-486f-aee4-a3a7d0b9f038 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:14.576601 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-95a84317-d303-486f-aee4-a3a7d0b9f038 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:14.577419 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-95a84317-d303-486f-aee4-a3a7d0b9f038 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:14.577904 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-95a84317-d303-486f-aee4-a3a7d0b9f038 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:14.594893 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-308ad736-a6fb-4b6c-97aa-450f3ec84dd7 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:14.595499 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-308ad736-a6fb-4b6c-97aa-450f3ec84dd7 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:14.601882 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-308ad736-a6fb-4b6c-97aa-450f3ec84dd7 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:14.602532 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-308ad736-a6fb-4b6c-97aa-450f3ec84dd7 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:14.603468 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-308ad736-a6fb-4b6c-97aa-450f3ec84dd7 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:14.604044 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-308ad736-a6fb-4b6c-97aa-450f3ec84dd7 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:14.675409 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-95a84317-d303-486f-aee4-a3a7d0b9f038 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:14.684425 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-95a84317-d303-486f-aee4-a3a7d0b9f038 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4" status: 200 len: 1275 microversion: 2.1 time: 0.123060 Jun 30 18:32:14.695008 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 274/541] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:14 2022] GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4 => generated 1275 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:14.725658 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-d8825aac-c438-478e-b330-634447ac92d6 req-c0332b22-8192-49c2-ba59-35d5e80e2b02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "319026da-aa9f-4e14-b11e-7dd9e8282964", "name": "network-vif-plugged", "status": "completed", "tag": "6a3d1631-84c7-4bb2-93fc-29048e75fe02"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:32:14.735145 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-d8825aac-c438-478e-b330-634447ac92d6 req-c0332b22-8192-49c2-ba59-35d5e80e2b02 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:14.735585 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-d8825aac-c438-478e-b330-634447ac92d6 req-c0332b22-8192-49c2-ba59-35d5e80e2b02 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:14.748001 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.compute.server_external_events [req-d8825aac-c438-478e-b330-634447ac92d6 req-c0332b22-8192-49c2-ba59-35d5e80e2b02 service nova] Creating event network-vif-plugged:6a3d1631-84c7-4bb2-93fc-29048e75fe02 for instance 319026da-aa9f-4e14-b11e-7dd9e8282964 on hv-cinder-80378 Jun 30 18:32:14.753621 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-d8825aac-c438-478e-b330-634447ac92d6 req-c0332b22-8192-49c2-ba59-35d5e80e2b02 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031330 Jun 30 18:32:14.754512 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 275/542] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:32:14.838318 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-308ad736-a6fb-4b6c-97aa-450f3ec84dd7 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:14.845494 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-308ad736-a6fb-4b6c-97aa-450f3ec84dd7 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1315 microversion: 2.1 time: 0.254401 Jun 30 18:32:14.846079 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 268/543] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:14 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:32:15.461835 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-fcbae8d6-7f1b-4b6a-a9e6-85e73c44e17d req-42f08a08-2544-4f2f-a36c-6bae1b46a8ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19968286-a102-4460-b41d-b98768d61ba4", "tag": "4411c747-aa4a-4d3e-b06a-20aa52b5883c"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:32:15.471774 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-fcbae8d6-7f1b-4b6a-a9e6-85e73c44e17d req-42f08a08-2544-4f2f-a36c-6bae1b46a8ba service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:15.472315 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-fcbae8d6-7f1b-4b6a-a9e6-85e73c44e17d req-42f08a08-2544-4f2f-a36c-6bae1b46a8ba service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:15.486576 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.compute.server_external_events [req-fcbae8d6-7f1b-4b6a-a9e6-85e73c44e17d req-42f08a08-2544-4f2f-a36c-6bae1b46a8ba service nova] Creating event network-changed:4411c747-aa4a-4d3e-b06a-20aa52b5883c for instance 19968286-a102-4460-b41d-b98768d61ba4 on hv-cinder-80378 Jun 30 18:32:15.492389 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-fcbae8d6-7f1b-4b6a-a9e6-85e73c44e17d req-42f08a08-2544-4f2f-a36c-6bae1b46a8ba service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034521 Jun 30 18:32:15.492993 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 276/544] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:32:15.702598 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-a33e2070-00c9-48ab-aa5e-b96c132ec0a3 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:15.703203 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-a33e2070-00c9-48ab-aa5e-b96c132ec0a3 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: 19968286-a102-4460-b41d-b98768d61ba4] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:15.710769 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a33e2070-00c9-48ab-aa5e-b96c132ec0a3 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:15.711215 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a33e2070-00c9-48ab-aa5e-b96c132ec0a3 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:15.711962 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a33e2070-00c9-48ab-aa5e-b96c132ec0a3 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:15.712390 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a33e2070-00c9-48ab-aa5e-b96c132ec0a3 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:15.841329 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-a33e2070-00c9-48ab-aa5e-b96c132ec0a3 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:15.849391 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-a33e2070-00c9-48ab-aa5e-b96c132ec0a3 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4" status: 200 len: 1317 microversion: 2.1 time: 0.150687 Jun 30 18:32:15.849978 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 269/545] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:15 2022] GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:15.862054 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-fa33907c-6a6d-45cf-a29c-dd0e205f9f18 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:15.862741 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-fa33907c-6a6d-45cf-a29c-dd0e205f9f18 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:15.869287 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fa33907c-6a6d-45cf-a29c-dd0e205f9f18 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:15.869776 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fa33907c-6a6d-45cf-a29c-dd0e205f9f18 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:15.870557 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fa33907c-6a6d-45cf-a29c-dd0e205f9f18 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:15.870983 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fa33907c-6a6d-45cf-a29c-dd0e205f9f18 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:16.006980 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-fa33907c-6a6d-45cf-a29c-dd0e205f9f18 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:16.015128 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-fa33907c-6a6d-45cf-a29c-dd0e205f9f18 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1315 microversion: 2.1 time: 0.157256 Jun 30 18:32:16.015892 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 277/546] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:15 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:16.866455 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-5b76cc2d-1db1-4d3e-8b74-357ed32d5d84 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:16.867065 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-5b76cc2d-1db1-4d3e-8b74-357ed32d5d84 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: 19968286-a102-4460-b41d-b98768d61ba4] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:16.873426 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5b76cc2d-1db1-4d3e-8b74-357ed32d5d84 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:16.873907 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5b76cc2d-1db1-4d3e-8b74-357ed32d5d84 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:16.874655 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5b76cc2d-1db1-4d3e-8b74-357ed32d5d84 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:16.875082 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5b76cc2d-1db1-4d3e-8b74-357ed32d5d84 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:17.009127 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-5b76cc2d-1db1-4d3e-8b74-357ed32d5d84 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:17.016522 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-5b76cc2d-1db1-4d3e-8b74-357ed32d5d84 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4" status: 200 len: 1317 microversion: 2.1 time: 0.154342 Jun 30 18:32:17.017073 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 270/547] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:16 2022] GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:17.034350 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-c1e3def2-a1fe-4b68-b385-350a7434db3a tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:17.034946 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-c1e3def2-a1fe-4b68-b385-350a7434db3a tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:17.041297 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c1e3def2-a1fe-4b68-b385-350a7434db3a tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:17.041786 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c1e3def2-a1fe-4b68-b385-350a7434db3a tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:17.042528 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c1e3def2-a1fe-4b68-b385-350a7434db3a tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:17.042952 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c1e3def2-a1fe-4b68-b385-350a7434db3a tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:17.171731 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-c1e3def2-a1fe-4b68-b385-350a7434db3a tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:17.180325 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-c1e3def2-a1fe-4b68-b385-350a7434db3a tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1315 microversion: 2.1 time: 0.149772 Jun 30 18:32:17.180887 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 278/548] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:17 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:18.034593 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-7bd77d2c-29ba-432e-9ac1-2f9297bd8bd8 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:18.035202 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-7bd77d2c-29ba-432e-9ac1-2f9297bd8bd8 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: 19968286-a102-4460-b41d-b98768d61ba4] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:18.041532 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7bd77d2c-29ba-432e-9ac1-2f9297bd8bd8 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:18.042018 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7bd77d2c-29ba-432e-9ac1-2f9297bd8bd8 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:18.042772 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7bd77d2c-29ba-432e-9ac1-2f9297bd8bd8 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:18.043200 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7bd77d2c-29ba-432e-9ac1-2f9297bd8bd8 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:18.176030 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-7bd77d2c-29ba-432e-9ac1-2f9297bd8bd8 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:18.183552 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-7bd77d2c-29ba-432e-9ac1-2f9297bd8bd8 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4" status: 200 len: 1317 microversion: 2.1 time: 0.153576 Jun 30 18:32:18.184120 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 271/549] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:18 2022] GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:18.196482 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-08fc7a4a-b688-407d-9f57-af73a54fc55b tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:18.197084 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-08fc7a4a-b688-407d-9f57-af73a54fc55b tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:18.203625 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-08fc7a4a-b688-407d-9f57-af73a54fc55b tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:18.204074 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-08fc7a4a-b688-407d-9f57-af73a54fc55b tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:18.204827 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-08fc7a4a-b688-407d-9f57-af73a54fc55b tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:18.205259 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-08fc7a4a-b688-407d-9f57-af73a54fc55b tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:18.330567 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-08fc7a4a-b688-407d-9f57-af73a54fc55b tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:18.338030 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-08fc7a4a-b688-407d-9f57-af73a54fc55b tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1315 microversion: 2.1 time: 0.145587 Jun 30 18:32:18.338597 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 279/550] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:18 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:19.200889 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-87183bec-182c-40d1-918c-9517980bc7dd tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:19.201829 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-87183bec-182c-40d1-918c-9517980bc7dd tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: 19968286-a102-4460-b41d-b98768d61ba4] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:19.208820 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-87183bec-182c-40d1-918c-9517980bc7dd tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:19.209256 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-87183bec-182c-40d1-918c-9517980bc7dd tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:19.210046 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-87183bec-182c-40d1-918c-9517980bc7dd tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:19.210465 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-87183bec-182c-40d1-918c-9517980bc7dd tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:19.340787 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-87183bec-182c-40d1-918c-9517980bc7dd tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:19.348849 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-87183bec-182c-40d1-918c-9517980bc7dd tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4" status: 200 len: 1317 microversion: 2.1 time: 0.151701 Jun 30 18:32:19.349420 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 272/551] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:19 2022] GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:19.355541 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-cde2fc7e-3cce-47d5-9934-46e1518fc812 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:19.356137 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-cde2fc7e-3cce-47d5-9934-46e1518fc812 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:19.363283 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-cde2fc7e-3cce-47d5-9934-46e1518fc812 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:19.363738 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-cde2fc7e-3cce-47d5-9934-46e1518fc812 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:19.364481 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-cde2fc7e-3cce-47d5-9934-46e1518fc812 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:19.364904 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-cde2fc7e-3cce-47d5-9934-46e1518fc812 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:19.493330 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-cde2fc7e-3cce-47d5-9934-46e1518fc812 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:19.500600 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-cde2fc7e-3cce-47d5-9934-46e1518fc812 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1315 microversion: 2.1 time: 0.148924 Jun 30 18:32:19.501175 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 280/552] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:19 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:32:20.365395 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-95b5b2bb-8433-452e-8e66-3ed6e13fc765 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:20.366032 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-95b5b2bb-8433-452e-8e66-3ed6e13fc765 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: 19968286-a102-4460-b41d-b98768d61ba4] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:20.367840 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell0:SELECT=2 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:32:20.368486 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell0:SELECT=6 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:32:20.374666 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-95b5b2bb-8433-452e-8e66-3ed6e13fc765 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:20.375109 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-95b5b2bb-8433-452e-8e66-3ed6e13fc765 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:20.375859 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-95b5b2bb-8433-452e-8e66-3ed6e13fc765 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:20.376287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-95b5b2bb-8433-452e-8e66-3ed6e13fc765 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:20.506474 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-95b5b2bb-8433-452e-8e66-3ed6e13fc765 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:20.514993 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-95b5b2bb-8433-452e-8e66-3ed6e13fc765 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4" status: 200 len: 1317 microversion: 2.1 time: 0.153501 Jun 30 18:32:20.515831 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 273/553] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:20 2022] GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:20.520307 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-09d0026f-eab9-4ca3-9667-61d220d9898a tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:20.520933 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-09d0026f-eab9-4ca3-9667-61d220d9898a tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:20.522946 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell0:SELECT=2 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:32:20.528576 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-09d0026f-eab9-4ca3-9667-61d220d9898a tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:20.529020 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-09d0026f-eab9-4ca3-9667-61d220d9898a tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:20.529803 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-09d0026f-eab9-4ca3-9667-61d220d9898a tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:20.530232 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-09d0026f-eab9-4ca3-9667-61d220d9898a tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:20.660893 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-09d0026f-eab9-4ca3-9667-61d220d9898a tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:20.668135 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-09d0026f-eab9-4ca3-9667-61d220d9898a tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1315 microversion: 2.1 time: 0.152858 Jun 30 18:32:20.668692 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 281/554] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:20 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:32:21.532116 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-f2398c93-e4ca-44cf-b2f6-5611fcceefa9 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:21.532713 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-f2398c93-e4ca-44cf-b2f6-5611fcceefa9 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: 19968286-a102-4460-b41d-b98768d61ba4] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:21.538997 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f2398c93-e4ca-44cf-b2f6-5611fcceefa9 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:21.539430 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f2398c93-e4ca-44cf-b2f6-5611fcceefa9 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:21.540171 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f2398c93-e4ca-44cf-b2f6-5611fcceefa9 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:21.540594 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f2398c93-e4ca-44cf-b2f6-5611fcceefa9 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:21.666591 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-f2398c93-e4ca-44cf-b2f6-5611fcceefa9 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:21.673890 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-f2398c93-e4ca-44cf-b2f6-5611fcceefa9 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4" status: 200 len: 1317 microversion: 2.1 time: 0.145640 Jun 30 18:32:21.674985 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 274/555] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:21 2022] GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4 => generated 1317 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:21.685011 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-e4403079-876e-4031-bc80-84cfc43f6e91 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:21.685631 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-e4403079-876e-4031-bc80-84cfc43f6e91 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:21.692757 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e4403079-876e-4031-bc80-84cfc43f6e91 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:21.693201 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e4403079-876e-4031-bc80-84cfc43f6e91 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:21.693975 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e4403079-876e-4031-bc80-84cfc43f6e91 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:21.694399 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e4403079-876e-4031-bc80-84cfc43f6e91 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:21.825757 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-e4403079-876e-4031-bc80-84cfc43f6e91 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:21.833556 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-e4403079-876e-4031-bc80-84cfc43f6e91 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1315 microversion: 2.1 time: 0.152314 Jun 30 18:32:21.834134 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 282/556] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:21 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:22.691841 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-971d8381-05fa-4286-85e3-9c5f6cf901fb tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:22.692454 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-971d8381-05fa-4286-85e3-9c5f6cf901fb tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: 19968286-a102-4460-b41d-b98768d61ba4] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:22.699230 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-971d8381-05fa-4286-85e3-9c5f6cf901fb tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:22.699673 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-971d8381-05fa-4286-85e3-9c5f6cf901fb tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:22.700430 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-971d8381-05fa-4286-85e3-9c5f6cf901fb tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:22.700876 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-971d8381-05fa-4286-85e3-9c5f6cf901fb tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:22.832706 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-971d8381-05fa-4286-85e3-9c5f6cf901fb tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:22.840014 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-971d8381-05fa-4286-85e3-9c5f6cf901fb tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4" status: 200 len: 1317 microversion: 2.1 time: 0.152641 Jun 30 18:32:22.840569 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 275/557] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:22 2022] GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:22.850257 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-c035e620-2e9b-4107-8bb7-1705b6f47f71 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:22.850854 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-c035e620-2e9b-4107-8bb7-1705b6f47f71 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:22.854086 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_api:SELECT=84 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:32:22.857625 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c035e620-2e9b-4107-8bb7-1705b6f47f71 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:22.858065 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c035e620-2e9b-4107-8bb7-1705b6f47f71 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:22.858804 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c035e620-2e9b-4107-8bb7-1705b6f47f71 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:22.859228 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c035e620-2e9b-4107-8bb7-1705b6f47f71 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:22.988551 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-c035e620-2e9b-4107-8bb7-1705b6f47f71 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:22.995869 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-c035e620-2e9b-4107-8bb7-1705b6f47f71 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1315 microversion: 2.1 time: 0.149599 Jun 30 18:32:22.996432 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 283/558] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:22 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:23.857152 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-12cd936c-4c37-4262-9385-4909c36c54d8 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:23.857784 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-12cd936c-4c37-4262-9385-4909c36c54d8 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: 19968286-a102-4460-b41d-b98768d61ba4] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:23.866894 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-12cd936c-4c37-4262-9385-4909c36c54d8 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:23.867341 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-12cd936c-4c37-4262-9385-4909c36c54d8 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:23.868110 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-12cd936c-4c37-4262-9385-4909c36c54d8 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:23.868541 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-12cd936c-4c37-4262-9385-4909c36c54d8 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:24.020619 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-6fc1ffb0-4a41-4274-a593-822fccef404b tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:24.021359 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-6fc1ffb0-4a41-4274-a593-822fccef404b tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:24.030904 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6fc1ffb0-4a41-4274-a593-822fccef404b tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:24.031355 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6fc1ffb0-4a41-4274-a593-822fccef404b tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:24.033851 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6fc1ffb0-4a41-4274-a593-822fccef404b tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:24.034764 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6fc1ffb0-4a41-4274-a593-822fccef404b tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:24.046187 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-12cd936c-4c37-4262-9385-4909c36c54d8 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:24.057834 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-12cd936c-4c37-4262-9385-4909c36c54d8 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4" status: 200 len: 1317 microversion: 2.1 time: 0.204133 Jun 30 18:32:24.069870 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 276/559] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:23 2022] GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4 => generated 1317 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:24.233323 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-6fc1ffb0-4a41-4274-a593-822fccef404b tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:24.236739 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell1:SELECT=100 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:32:24.241790 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-6fc1ffb0-4a41-4274-a593-822fccef404b tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1465 microversion: 2.1 time: 0.225522 Jun 30 18:32:24.242369 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 284/560] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:24 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1465 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:32:24.285214 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-cf22b675-d11e-44d9-90e4-5fd6f5a6a8dd tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:24.285747 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-cf22b675-d11e-44d9-90e4-5fd6f5a6a8dd tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:24.291702 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cf22b675-d11e-44d9-90e4-5fd6f5a6a8dd tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:24.292154 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cf22b675-d11e-44d9-90e4-5fd6f5a6a8dd tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:24.292907 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cf22b675-d11e-44d9-90e4-5fd6f5a6a8dd tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:24.293340 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cf22b675-d11e-44d9-90e4-5fd6f5a6a8dd tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:24.318791 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-cf22b675-d11e-44d9-90e4-5fd6f5a6a8dd tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Going to try to terminate instance {{(pid=117940) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 18:32:24.354953 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:32:24.403440 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-cf22b675-d11e-44d9-90e4-5fd6f5a6a8dd tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "DELETE /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 204 len: 0 microversion: 2.1 time: 0.121765 Jun 30 18:32:24.404834 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 277/561] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 30 18:32:24 2022] DELETE /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 18:32:24.413151 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-74ce87ea-c1d4-48b5-9fb0-521a090658a6 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:24.413786 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-74ce87ea-c1d4-48b5-9fb0-521a090658a6 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:24.420574 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-74ce87ea-c1d4-48b5-9fb0-521a090658a6 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:24.420966 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-74ce87ea-c1d4-48b5-9fb0-521a090658a6 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:24.421753 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-74ce87ea-c1d4-48b5-9fb0-521a090658a6 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:24.422179 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-74ce87ea-c1d4-48b5-9fb0-521a090658a6 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:24.562516 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-74ce87ea-c1d4-48b5-9fb0-521a090658a6 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:24.570582 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-74ce87ea-c1d4-48b5-9fb0-521a090658a6 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1471 microversion: 2.1 time: 0.161436 Jun 30 18:32:24.571379 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 285/562] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:24 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1471 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:25.078241 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-f6acf8b2-c28f-4f01-8dbd-4e5e7d8078fe tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:25.078927 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-f6acf8b2-c28f-4f01-8dbd-4e5e7d8078fe tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: 19968286-a102-4460-b41d-b98768d61ba4] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:25.085738 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f6acf8b2-c28f-4f01-8dbd-4e5e7d8078fe tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:25.085990 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f6acf8b2-c28f-4f01-8dbd-4e5e7d8078fe tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:25.087361 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f6acf8b2-c28f-4f01-8dbd-4e5e7d8078fe tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:25.087361 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f6acf8b2-c28f-4f01-8dbd-4e5e7d8078fe tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:25.227970 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-f6acf8b2-c28f-4f01-8dbd-4e5e7d8078fe tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:25.235408 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-f6acf8b2-c28f-4f01-8dbd-4e5e7d8078fe tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4" status: 200 len: 1317 microversion: 2.1 time: 0.161403 Jun 30 18:32:25.235979 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 278/563] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:25 2022] GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:25.588665 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-f452be76-da15-4d3b-bbcf-979fc45bc4e5 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:25.589273 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-f452be76-da15-4d3b-bbcf-979fc45bc4e5 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:25.597111 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f452be76-da15-4d3b-bbcf-979fc45bc4e5 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:25.597813 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f452be76-da15-4d3b-bbcf-979fc45bc4e5 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:25.598582 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f452be76-da15-4d3b-bbcf-979fc45bc4e5 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:25.599015 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f452be76-da15-4d3b-bbcf-979fc45bc4e5 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:25.741247 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-f452be76-da15-4d3b-bbcf-979fc45bc4e5 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:25.749362 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-f452be76-da15-4d3b-bbcf-979fc45bc4e5 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1471 microversion: 2.1 time: 0.165253 Jun 30 18:32:25.749960 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 286/564] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:25 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1471 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:26.253854 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-0718fe38-1c61-4c9b-b095-9111e8bc416a tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:26.254633 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-0718fe38-1c61-4c9b-b095-9111e8bc416a tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: 19968286-a102-4460-b41d-b98768d61ba4] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:26.260539 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0718fe38-1c61-4c9b-b095-9111e8bc416a tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:26.261793 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0718fe38-1c61-4c9b-b095-9111e8bc416a tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:26.261793 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0718fe38-1c61-4c9b-b095-9111e8bc416a tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:26.262185 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0718fe38-1c61-4c9b-b095-9111e8bc416a tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:26.396409 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-0718fe38-1c61-4c9b-b095-9111e8bc416a tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:26.403800 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-0718fe38-1c61-4c9b-b095-9111e8bc416a tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4" status: 200 len: 1317 microversion: 2.1 time: 0.154559 Jun 30 18:32:26.404377 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 279/565] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:26 2022] GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:26.767620 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-086d0563-f92d-4c3d-adb0-097d779b15e9 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:26.769990 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-086d0563-f92d-4c3d-adb0-097d779b15e9 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:26.777195 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-086d0563-f92d-4c3d-adb0-097d779b15e9 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:26.777851 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-086d0563-f92d-4c3d-adb0-097d779b15e9 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:26.778689 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-086d0563-f92d-4c3d-adb0-097d779b15e9 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:26.779260 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-086d0563-f92d-4c3d-adb0-097d779b15e9 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:26.917969 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-086d0563-f92d-4c3d-adb0-097d779b15e9 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:26.927425 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-086d0563-f92d-4c3d-adb0-097d779b15e9 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1471 microversion: 2.1 time: 0.163960 Jun 30 18:32:26.928002 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 287/566] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:26 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1471 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:27.421703 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-7d2ec4c6-3bf1-43b4-9395-4f552e54e549 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:27.422370 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-7d2ec4c6-3bf1-43b4-9395-4f552e54e549 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: 19968286-a102-4460-b41d-b98768d61ba4] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:27.429291 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7d2ec4c6-3bf1-43b4-9395-4f552e54e549 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:27.430089 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7d2ec4c6-3bf1-43b4-9395-4f552e54e549 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:27.431150 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7d2ec4c6-3bf1-43b4-9395-4f552e54e549 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:27.431659 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7d2ec4c6-3bf1-43b4-9395-4f552e54e549 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:27.628298 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-7d2ec4c6-3bf1-43b4-9395-4f552e54e549 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:27.636637 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-7d2ec4c6-3bf1-43b4-9395-4f552e54e549 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4" status: 200 len: 1317 microversion: 2.1 time: 0.218908 Jun 30 18:32:27.637734 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 280/567] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:27 2022] GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4 => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:27.946179 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-b23dffea-4e9f-43aa-9397-ab00882636bb tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:27.947875 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-b23dffea-4e9f-43aa-9397-ab00882636bb tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:27.954919 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b23dffea-4e9f-43aa-9397-ab00882636bb tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:27.955587 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b23dffea-4e9f-43aa-9397-ab00882636bb tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:27.956810 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b23dffea-4e9f-43aa-9397-ab00882636bb tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:27.957547 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b23dffea-4e9f-43aa-9397-ab00882636bb tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:28.180312 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-b23dffea-4e9f-43aa-9397-ab00882636bb tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:28.191256 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-b23dffea-4e9f-43aa-9397-ab00882636bb tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1471 microversion: 2.1 time: 0.246742 Jun 30 18:32:28.192161 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 288/568] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:27 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1471 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:32:28.654720 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-2c95ea0e-ef1d-48fd-8183-49e9291f90b7 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:28.660373 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-2c95ea0e-ef1d-48fd-8183-49e9291f90b7 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: 19968286-a102-4460-b41d-b98768d61ba4] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:28.667598 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-2c95ea0e-ef1d-48fd-8183-49e9291f90b7 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:28.668203 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-2c95ea0e-ef1d-48fd-8183-49e9291f90b7 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:28.669070 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-2c95ea0e-ef1d-48fd-8183-49e9291f90b7 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:28.669569 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-2c95ea0e-ef1d-48fd-8183-49e9291f90b7 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:28.809612 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-2c95ea0e-ef1d-48fd-8183-49e9291f90b7 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:28.817702 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-2c95ea0e-ef1d-48fd-8183-49e9291f90b7 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4" status: 200 len: 1317 microversion: 2.1 time: 0.166834 Jun 30 18:32:28.818653 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 281/569] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:28 2022] GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:29.216144 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-d28961cf-6527-45d3-af96-4e71aa2cfb1f tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:29.218089 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-d28961cf-6527-45d3-af96-4e71aa2cfb1f tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:29.226766 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d28961cf-6527-45d3-af96-4e71aa2cfb1f tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:29.227598 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d28961cf-6527-45d3-af96-4e71aa2cfb1f tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:29.228528 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d28961cf-6527-45d3-af96-4e71aa2cfb1f tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:29.229124 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d28961cf-6527-45d3-af96-4e71aa2cfb1f tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:29.381440 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-d28961cf-6527-45d3-af96-4e71aa2cfb1f tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:29.389810 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-d28961cf-6527-45d3-af96-4e71aa2cfb1f tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1471 microversion: 2.1 time: 0.185097 Jun 30 18:32:29.390739 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 289/570] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:29 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1471 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:29.836106 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-d8b806e0-df69-4196-b8e5-26425513926f tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:29.837553 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-d8b806e0-df69-4196-b8e5-26425513926f tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: 19968286-a102-4460-b41d-b98768d61ba4] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:29.844606 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d8b806e0-df69-4196-b8e5-26425513926f tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:29.845150 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d8b806e0-df69-4196-b8e5-26425513926f tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:29.846088 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d8b806e0-df69-4196-b8e5-26425513926f tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:29.847605 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d8b806e0-df69-4196-b8e5-26425513926f tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:30.004666 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-d8b806e0-df69-4196-b8e5-26425513926f tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:30.013534 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-d8b806e0-df69-4196-b8e5-26425513926f tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4" status: 200 len: 1317 microversion: 2.1 time: 0.181295 Jun 30 18:32:30.014135 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 282/571] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:29 2022] GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4 => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:30.412938 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-aeb9819a-ab90-4862-81d4-26854a2cff51 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:30.414588 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-aeb9819a-ab90-4862-81d4-26854a2cff51 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:30.422175 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-aeb9819a-ab90-4862-81d4-26854a2cff51 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:30.422925 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-aeb9819a-ab90-4862-81d4-26854a2cff51 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:30.424413 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-aeb9819a-ab90-4862-81d4-26854a2cff51 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:30.426209 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-aeb9819a-ab90-4862-81d4-26854a2cff51 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:30.590971 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-aeb9819a-ab90-4862-81d4-26854a2cff51 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:30.601285 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-aeb9819a-ab90-4862-81d4-26854a2cff51 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1471 microversion: 2.1 time: 0.196160 Jun 30 18:32:30.602647 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 290/572] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:30 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1471 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:31.031700 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-8dad4359-077b-4532-8024-9633e7586bc3 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:31.032313 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-8dad4359-077b-4532-8024-9633e7586bc3 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: 19968286-a102-4460-b41d-b98768d61ba4] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:31.039034 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8dad4359-077b-4532-8024-9633e7586bc3 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:31.039820 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8dad4359-077b-4532-8024-9633e7586bc3 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:31.040581 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8dad4359-077b-4532-8024-9633e7586bc3 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:31.041188 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8dad4359-077b-4532-8024-9633e7586bc3 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:31.188780 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-8dad4359-077b-4532-8024-9633e7586bc3 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:31.199290 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-8dad4359-077b-4532-8024-9633e7586bc3 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4" status: 200 len: 1317 microversion: 2.1 time: 0.171408 Jun 30 18:32:31.200481 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 283/573] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:31 2022] GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:31.623100 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-e588dc67-897d-4c81-aa7d-7784bb2e832f tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:31.623880 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-e588dc67-897d-4c81-aa7d-7784bb2e832f tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:31.634711 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e588dc67-897d-4c81-aa7d-7784bb2e832f tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:31.635384 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e588dc67-897d-4c81-aa7d-7784bb2e832f tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:31.637127 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e588dc67-897d-4c81-aa7d-7784bb2e832f tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:31.637991 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e588dc67-897d-4c81-aa7d-7784bb2e832f tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:31.781508 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-e588dc67-897d-4c81-aa7d-7784bb2e832f tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:31.790422 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-e588dc67-897d-4c81-aa7d-7784bb2e832f tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1471 microversion: 2.1 time: 0.173119 Jun 30 18:32:31.790990 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 291/574] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:31 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1471 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:32.216749 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-beb6c017-8a50-42d6-bca2-0c13c5621d89 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:32.217496 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-beb6c017-8a50-42d6-bca2-0c13c5621d89 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: 19968286-a102-4460-b41d-b98768d61ba4] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:32.225389 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-beb6c017-8a50-42d6-bca2-0c13c5621d89 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:32.225941 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-beb6c017-8a50-42d6-bca2-0c13c5621d89 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:32.226712 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-beb6c017-8a50-42d6-bca2-0c13c5621d89 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:32.227144 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-beb6c017-8a50-42d6-bca2-0c13c5621d89 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:32.371977 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-beb6c017-8a50-42d6-bca2-0c13c5621d89 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:32.381057 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-beb6c017-8a50-42d6-bca2-0c13c5621d89 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4" status: 200 len: 1317 microversion: 2.1 time: 0.168177 Jun 30 18:32:32.392888 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 284/575] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:32 2022] GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4 => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:32.808064 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-27f671ea-b75d-496e-80b9-163c193815c6 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:32.809745 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-27f671ea-b75d-496e-80b9-163c193815c6 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:32.817301 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-27f671ea-b75d-496e-80b9-163c193815c6 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:32.817856 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-27f671ea-b75d-496e-80b9-163c193815c6 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:32.818805 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-27f671ea-b75d-496e-80b9-163c193815c6 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:32.819922 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-27f671ea-b75d-496e-80b9-163c193815c6 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:32.985126 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-27f671ea-b75d-496e-80b9-163c193815c6 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:32.994438 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-27f671ea-b75d-496e-80b9-163c193815c6 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1471 microversion: 2.1 time: 0.190267 Jun 30 18:32:33.008243 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 292/576] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:32 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1471 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:33.398758 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-532bdb3c-281e-4c17-960f-454cf6fda0d0 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:33.399464 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-532bdb3c-281e-4c17-960f-454cf6fda0d0 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: 19968286-a102-4460-b41d-b98768d61ba4] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:33.406090 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-532bdb3c-281e-4c17-960f-454cf6fda0d0 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:33.406839 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-532bdb3c-281e-4c17-960f-454cf6fda0d0 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:33.407841 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-532bdb3c-281e-4c17-960f-454cf6fda0d0 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:33.408734 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-532bdb3c-281e-4c17-960f-454cf6fda0d0 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:33.587542 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-532bdb3c-281e-4c17-960f-454cf6fda0d0 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:33.609790 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-532bdb3c-281e-4c17-960f-454cf6fda0d0 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4" status: 200 len: 1317 microversion: 2.1 time: 0.214906 Jun 30 18:32:33.610375 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 285/577] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:33 2022] GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4 => generated 1317 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:34.012916 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-9bfd9939-af9b-4847-8f8d-3aebf6a8041d tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:34.013714 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-9bfd9939-af9b-4847-8f8d-3aebf6a8041d tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:34.023798 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9bfd9939-af9b-4847-8f8d-3aebf6a8041d tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:34.024391 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9bfd9939-af9b-4847-8f8d-3aebf6a8041d tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:34.025437 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9bfd9939-af9b-4847-8f8d-3aebf6a8041d tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:34.026035 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9bfd9939-af9b-4847-8f8d-3aebf6a8041d tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:34.166281 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-9bfd9939-af9b-4847-8f8d-3aebf6a8041d tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:34.174400 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-9bfd9939-af9b-4847-8f8d-3aebf6a8041d tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1471 microversion: 2.1 time: 0.165550 Jun 30 18:32:34.175073 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 293/578] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:34 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1471 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:34.627158 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-59a466ef-2f80-4be3-b939-e6b788bdf1a4 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:34.631323 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-59a466ef-2f80-4be3-b939-e6b788bdf1a4 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: 19968286-a102-4460-b41d-b98768d61ba4] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:34.660696 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-59a466ef-2f80-4be3-b939-e6b788bdf1a4 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:34.661062 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-59a466ef-2f80-4be3-b939-e6b788bdf1a4 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:34.661903 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-59a466ef-2f80-4be3-b939-e6b788bdf1a4 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:34.662341 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-59a466ef-2f80-4be3-b939-e6b788bdf1a4 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:34.809136 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-59a466ef-2f80-4be3-b939-e6b788bdf1a4 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:34.818012 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-59a466ef-2f80-4be3-b939-e6b788bdf1a4 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4" status: 200 len: 1317 microversion: 2.1 time: 0.194860 Jun 30 18:32:34.818600 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 286/579] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:34 2022] GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4 => generated 1317 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:35.192168 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-a6a56356-c663-41c6-8ad6-760d1066b098 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:35.193618 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-a6a56356-c663-41c6-8ad6-760d1066b098 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:35.200853 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a6a56356-c663-41c6-8ad6-760d1066b098 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:35.201569 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a6a56356-c663-41c6-8ad6-760d1066b098 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:35.202361 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a6a56356-c663-41c6-8ad6-760d1066b098 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:35.202750 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a6a56356-c663-41c6-8ad6-760d1066b098 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:35.373532 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-a6a56356-c663-41c6-8ad6-760d1066b098 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:35.382100 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-a6a56356-c663-41c6-8ad6-760d1066b098 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1471 microversion: 2.1 time: 0.193928 Jun 30 18:32:35.392238 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 294/580] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:35 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1471 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:35.836052 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-15cd3488-8599-4b5e-9b6b-0e16353aa851 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:35.836676 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-15cd3488-8599-4b5e-9b6b-0e16353aa851 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: 19968286-a102-4460-b41d-b98768d61ba4] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:35.843368 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-15cd3488-8599-4b5e-9b6b-0e16353aa851 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:35.843812 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-15cd3488-8599-4b5e-9b6b-0e16353aa851 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:35.844773 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-15cd3488-8599-4b5e-9b6b-0e16353aa851 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:35.845240 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-15cd3488-8599-4b5e-9b6b-0e16353aa851 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:35.997243 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-15cd3488-8599-4b5e-9b6b-0e16353aa851 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:36.005631 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-15cd3488-8599-4b5e-9b6b-0e16353aa851 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4" status: 200 len: 1317 microversion: 2.1 time: 0.174245 Jun 30 18:32:36.006202 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 287/581] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:35 2022] GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:36.399641 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-73f159ae-7bca-4b10-bdcf-a12d126113e2 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:36.400266 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-73f159ae-7bca-4b10-bdcf-a12d126113e2 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:36.406608 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-73f159ae-7bca-4b10-bdcf-a12d126113e2 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:36.407250 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-73f159ae-7bca-4b10-bdcf-a12d126113e2 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:36.408166 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-73f159ae-7bca-4b10-bdcf-a12d126113e2 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:36.408586 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-73f159ae-7bca-4b10-bdcf-a12d126113e2 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:36.549674 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-73f159ae-7bca-4b10-bdcf-a12d126113e2 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:36.558052 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-73f159ae-7bca-4b10-bdcf-a12d126113e2 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1471 microversion: 2.1 time: 0.162095 Jun 30 18:32:36.558634 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 295/582] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:36 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1471 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:37.023858 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-cab98c49-1b8a-481a-9e40-8589655d635c tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:37.024465 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-cab98c49-1b8a-481a-9e40-8589655d635c tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: 19968286-a102-4460-b41d-b98768d61ba4] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:37.035912 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cab98c49-1b8a-481a-9e40-8589655d635c tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:37.036351 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cab98c49-1b8a-481a-9e40-8589655d635c tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:37.037356 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cab98c49-1b8a-481a-9e40-8589655d635c tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:37.037771 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cab98c49-1b8a-481a-9e40-8589655d635c tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:37.199741 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-cab98c49-1b8a-481a-9e40-8589655d635c tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:37.209104 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-cab98c49-1b8a-481a-9e40-8589655d635c tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4" status: 200 len: 1317 microversion: 2.1 time: 0.190359 Jun 30 18:32:37.219404 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 288/583] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:37 2022] GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4 => generated 1317 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:37.577080 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-3fc9c1e0-393f-4dd9-836d-3e3313c48a95 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:37.578454 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-3fc9c1e0-393f-4dd9-836d-3e3313c48a95 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:37.587495 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3fc9c1e0-393f-4dd9-836d-3e3313c48a95 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:37.588467 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3fc9c1e0-393f-4dd9-836d-3e3313c48a95 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:37.590451 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3fc9c1e0-393f-4dd9-836d-3e3313c48a95 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:37.590953 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3fc9c1e0-393f-4dd9-836d-3e3313c48a95 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:37.951742 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [req-d73613cb-d093-4eec-80eb-7eaf20109fe6 req-1fdeda32-ce35-4b1a-b840-c45fac0743cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "319026da-aa9f-4e14-b11e-7dd9e8282964", "name": "network-vif-deleted", "tag": "6a3d1631-84c7-4bb2-93fc-29048e75fe02"}]} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:32:37.962491 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-3fc9c1e0-393f-4dd9-836d-3e3313c48a95 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d29f9c3387847b4bebaba3a1e3c0be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72283c6d9d6b4f529e8f195c8ebbca64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:37.975375 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-3fc9c1e0-393f-4dd9-836d-3e3313c48a95 tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 200 len: 1471 microversion: 2.1 time: 0.403553 Jun 30 18:32:37.982456 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 296/584] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:37 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 1471 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:37.982918 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:32:38.002435 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-d73613cb-d093-4eec-80eb-7eaf20109fe6 req-1fdeda32-ce35-4b1a-b840-c45fac0743cb service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:38.007473 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-d73613cb-d093-4eec-80eb-7eaf20109fe6 req-1fdeda32-ce35-4b1a-b840-c45fac0743cb service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:38.045645 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.compute.server_external_events [req-d73613cb-d093-4eec-80eb-7eaf20109fe6 req-1fdeda32-ce35-4b1a-b840-c45fac0743cb service nova] Creating event network-vif-deleted:6a3d1631-84c7-4bb2-93fc-29048e75fe02 for instance 319026da-aa9f-4e14-b11e-7dd9e8282964 on hv-cinder-80378 Jun 30 18:32:38.071517 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [req-d73613cb-d093-4eec-80eb-7eaf20109fe6 req-1fdeda32-ce35-4b1a-b840-c45fac0743cb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124222 Jun 30 18:32:38.078697 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 289/585] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:32:38.229027 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-0ad67bbb-6d73-4511-8151-df44c835836e tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:38.231114 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-0ad67bbb-6d73-4511-8151-df44c835836e tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: 19968286-a102-4460-b41d-b98768d61ba4] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:38.239592 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0ad67bbb-6d73-4511-8151-df44c835836e tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:38.240211 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0ad67bbb-6d73-4511-8151-df44c835836e tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:38.241043 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0ad67bbb-6d73-4511-8151-df44c835836e tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:38.241609 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0ad67bbb-6d73-4511-8151-df44c835836e tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:38.398909 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-0ad67bbb-6d73-4511-8151-df44c835836e tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:38.406297 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-0ad67bbb-6d73-4511-8151-df44c835836e tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4" status: 200 len: 1317 microversion: 2.1 time: 0.181775 Jun 30 18:32:38.407176 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 297/586] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:38 2022] GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4 => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:39.005511 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-5b063a29-21b6-435a-a0ee-e70095625aac tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:39.006534 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-5b063a29-21b6-435a-a0ee-e70095625aac tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] [instance: 319026da-aa9f-4e14-b11e-7dd9e8282964] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:39.019821 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5b063a29-21b6-435a-a0ee-e70095625aac tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:39.020256 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5b063a29-21b6-435a-a0ee-e70095625aac tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:39.027557 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5b063a29-21b6-435a-a0ee-e70095625aac tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:39.028999 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5b063a29-21b6-435a-a0ee-e70095625aac tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:39.045311 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.wsgi [None req-5b063a29-21b6-435a-a0ee-e70095625aac tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] HTTP exception thrown: Instance 319026da-aa9f-4e14-b11e-7dd9e8282964 could not be found. Jun 30 18:32:39.047187 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-5b063a29-21b6-435a-a0ee-e70095625aac tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Request method failure captured: Jun 30 18:32:39.047187 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: request: GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 HTTP/1.1 Jun 30 18:32:39.047187 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept: application/json Jun 30 18:32:39.047187 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept-Encoding: identity Jun 30 18:32:39.047187 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Connection: close Jun 30 18:32:39.047187 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Length: 0 Jun 30 18:32:39.047187 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Type: application/json Jun 30 18:32:39.047187 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Host: 10.222.0.33 Jun 30 18:32:39.047187 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Openstack-System-Scope: None Jun 30 18:32:39.047187 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: User-Agent: python-urllib3/1.26.9 Jun 30 18:32:39.047187 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Auth-Token: gAAAAABivewGMc0BUb1QaG_ZatTgeKZRbUJ37vidxSdwG1lPZfrEN14Zgv23OjfsnS18um8i9cN3iPUWfuLs5JBrtCVJFiavlDNDPUpvZ-EAnRdHtCA1thSKOknDCwbTiu6A6blmn-5C9cdl4TXI-KIUEJvIxr_KkEtOjW5lJ6MJEWjw4dpRc-k Jun 30 18:32:39.047187 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Id: None Jun 30 18:32:39.047187 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Name: None Jun 30 18:32:39.047187 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Identity-Status: Confirmed Jun 30 18:32:39.047187 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Is-Admin-Project: True Jun 30 18:32:39.047187 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Id: default Jun 30 18:32:39.047187 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Name: Default Jun 30 18:32:39.047187 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Id: 72283c6d9d6b4f529e8f195c8ebbca64 Jun 30 18:32:39.047187 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Name: tempest-VolumesNegativeTest-202686860 Jun 30 18:32:39.047187 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Role: reader,member Jun 30 18:32:39.047187 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Roles: reader,member Jun 30 18:32:39.049725 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/72283c6d9d6b4f529e8f195c8ebbca64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_72283c6d9d6b4f529e8f195c8ebbca64"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/72283c6d9d6b4f529e8f195c8ebbca64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/72283c6d9d6b4f529e8f195c8ebbca64"}]}] Jun 30 18:32:39.049725 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant: tempest-VolumesNegativeTest-202686860 Jun 30 18:32:39.049725 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Id: 72283c6d9d6b4f529e8f195c8ebbca64 Jun 30 18:32:39.049725 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Name: tempest-VolumesNegativeTest-202686860 Jun 30 18:32:39.049725 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User: tempest-VolumesNegativeTest-202686860-project Jun 30 18:32:39.049725 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Id: default Jun 30 18:32:39.049725 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Name: Default Jun 30 18:32:39.049725 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Id: 2d29f9c3387847b4bebaba3a1e3c0be8 Jun 30 18:32:39.049725 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Name: tempest-VolumesNegativeTest-202686860-project Jun 30 18:32:39.049725 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: method: > Jun 30 18:32:39.049725 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: exception: Instance 319026da-aa9f-4e14-b11e-7dd9e8282964 could not be found. Jun 30 18:32:39.049725 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: action_args: {'id': '319026da-aa9f-4e14-b11e-7dd9e8282964'} Jun 30 18:32:39.051278 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:32:39.051278 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:32:39.051278 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:32:39.051278 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:32:39.051278 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:32:39.051278 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:32:39.051278 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:32:39.051278 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:32:39.051278 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:32:39.051278 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:32:39.051278 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 319026da-aa9f-4e14-b11e-7dd9e8282964 could not be found. Jun 30 18:32:39.051278 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:32:39.051278 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:32:39.051278 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:32:39.051278 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:32:39.051278 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:32:39.051278 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:32:39.051278 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:32:39.051278 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:32:39.051278 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:32:39.052496 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:32:39.052496 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:32:39.052496 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:32:39.052496 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:32:39.052496 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:32:39.052496 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:32:39.052496 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:32:39.052496 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 319026da-aa9f-4e14-b11e-7dd9e8282964 could not be found. Jun 30 18:32:39.052496 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:32:39.052496 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:32:39.052496 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:32:39.052496 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:32:39.052496 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:32:39.052496 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:32:39.052496 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:32:39.052496 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:32:39.052496 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 319026da-aa9f-4e14-b11e-7dd9e8282964 could not be found. Jun 30 18:32:39.052496 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:32:39.053627 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-5b063a29-21b6-435a-a0ee-e70095625aac tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] Returning 404 to user: Instance 319026da-aa9f-4e14-b11e-7dd9e8282964 could not be found. {{(pid=117940) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:32:39.053627 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-5b063a29-21b6-435a-a0ee-e70095625aac tempest-VolumesNegativeTest-202686860 tempest-VolumesNegativeTest-202686860-project] 10.222.0.33 "GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964" status: 404 len: 111 microversion: 2.1 time: 0.058201 Jun 30 18:32:39.053627 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 290/587] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:38 2022] GET /compute/v2.1/servers/319026da-aa9f-4e14-b11e-7dd9e8282964 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:32:39.423912 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-6ccb609b-309a-4ae2-9f91-7ca345f6bf99 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:39.424654 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-6ccb609b-309a-4ae2-9f91-7ca345f6bf99 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: 19968286-a102-4460-b41d-b98768d61ba4] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:39.434980 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6ccb609b-309a-4ae2-9f91-7ca345f6bf99 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:39.435779 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6ccb609b-309a-4ae2-9f91-7ca345f6bf99 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:39.436821 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6ccb609b-309a-4ae2-9f91-7ca345f6bf99 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:39.437476 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6ccb609b-309a-4ae2-9f91-7ca345f6bf99 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:39.638220 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-6ccb609b-309a-4ae2-9f91-7ca345f6bf99 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:39.650329 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-6ccb609b-309a-4ae2-9f91-7ca345f6bf99 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4" status: 200 len: 1317 microversion: 2.1 time: 0.230152 Jun 30 18:32:39.655465 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 298/588] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:39 2022] GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4 => generated 1317 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:39.836218 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [req-0a2ef0d8-efa1-4245-ab80-e19865746291 req-0b59edfc-b5fe-414f-a00b-49957d5774ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19968286-a102-4460-b41d-b98768d61ba4", "name": "network-vif-plugged", "status": "completed", "tag": "4411c747-aa4a-4d3e-b06a-20aa52b5883c"}]} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:32:39.848472 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-0a2ef0d8-efa1-4245-ab80-e19865746291 req-0b59edfc-b5fe-414f-a00b-49957d5774ad service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:39.849262 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-0a2ef0d8-efa1-4245-ab80-e19865746291 req-0b59edfc-b5fe-414f-a00b-49957d5774ad service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:39.864197 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.compute.server_external_events [req-0a2ef0d8-efa1-4245-ab80-e19865746291 req-0b59edfc-b5fe-414f-a00b-49957d5774ad service nova] Creating event network-vif-plugged:4411c747-aa4a-4d3e-b06a-20aa52b5883c for instance 19968286-a102-4460-b41d-b98768d61ba4 on hv-cinder-80378 Jun 30 18:32:39.870481 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [req-0a2ef0d8-efa1-4245-ab80-e19865746291 req-0b59edfc-b5fe-414f-a00b-49957d5774ad service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037758 Jun 30 18:32:39.871460 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 291/589] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:32:40.672985 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-9ac9900f-85dc-4608-840f-97b8aa5c046a tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:40.675776 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-9ac9900f-85dc-4608-840f-97b8aa5c046a tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: 19968286-a102-4460-b41d-b98768d61ba4] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:40.684157 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9ac9900f-85dc-4608-840f-97b8aa5c046a tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:40.684657 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9ac9900f-85dc-4608-840f-97b8aa5c046a tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:40.685496 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9ac9900f-85dc-4608-840f-97b8aa5c046a tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:40.686164 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9ac9900f-85dc-4608-840f-97b8aa5c046a tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:40.860614 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-9ac9900f-85dc-4608-840f-97b8aa5c046a tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:40.876734 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-9ac9900f-85dc-4608-840f-97b8aa5c046a tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4" status: 200 len: 1317 microversion: 2.1 time: 0.208236 Jun 30 18:32:40.877325 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 299/590] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:40 2022] GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4 => generated 1317 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:41.895653 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-ae1d1260-7b82-45b1-9132-933f89e62a09 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:41.896387 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-ae1d1260-7b82-45b1-9132-933f89e62a09 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: 19968286-a102-4460-b41d-b98768d61ba4] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:41.903408 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ae1d1260-7b82-45b1-9132-933f89e62a09 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:41.904014 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ae1d1260-7b82-45b1-9132-933f89e62a09 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:41.904966 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ae1d1260-7b82-45b1-9132-933f89e62a09 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:41.905473 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ae1d1260-7b82-45b1-9132-933f89e62a09 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:42.106212 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-ae1d1260-7b82-45b1-9132-933f89e62a09 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:42.114380 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-ae1d1260-7b82-45b1-9132-933f89e62a09 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4" status: 200 len: 1317 microversion: 2.1 time: 0.224052 Jun 30 18:32:42.114990 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 292/591] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:41 2022] GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4 => generated 1317 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:43.132749 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-9f2ea623-ded7-4ce3-813b-a0a95bc3e2c2 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:43.133346 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-9f2ea623-ded7-4ce3-813b-a0a95bc3e2c2 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: 19968286-a102-4460-b41d-b98768d61ba4] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:43.140330 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9f2ea623-ded7-4ce3-813b-a0a95bc3e2c2 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:43.140715 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9f2ea623-ded7-4ce3-813b-a0a95bc3e2c2 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:43.141520 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9f2ea623-ded7-4ce3-813b-a0a95bc3e2c2 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:43.142030 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9f2ea623-ded7-4ce3-813b-a0a95bc3e2c2 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:43.284274 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-9f2ea623-ded7-4ce3-813b-a0a95bc3e2c2 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:43.292356 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-9f2ea623-ded7-4ce3-813b-a0a95bc3e2c2 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4" status: 200 len: 1506 microversion: 2.1 time: 0.164542 Jun 30 18:32:43.292925 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 300/592] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:43 2022] GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4 => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:43.310581 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-7db2b134-42d9-4c1c-9bfa-fce9ddca9660 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0d37ead-a008-43d0-bf56-37bb591e4021", "device": "/dev/sdb"}} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:32:43.311738 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-7db2b134-42d9-4c1c-9bfa-fce9ddca9660 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: 19968286-a102-4460-b41d-b98768d61ba4] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:43.319840 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7db2b134-42d9-4c1c-9bfa-fce9ddca9660 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:43.320374 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7db2b134-42d9-4c1c-9bfa-fce9ddca9660 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:43.321222 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7db2b134-42d9-4c1c-9bfa-fce9ddca9660 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:43.321763 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7db2b134-42d9-4c1c-9bfa-fce9ddca9660 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:43.624370 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-7db2b134-42d9-4c1c-9bfa-fce9ddca9660 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "POST /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.317896 Jun 30 18:32:43.625046 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 293/593] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 30 18:32:43 2022] POST /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4/os-volume_attachments => generated 194 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:32:45.501269 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-28a0d853-f54b-4bf0-b2b7-99918fefcd8f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:45.501858 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-28a0d853-f54b-4bf0-b2b7-99918fefcd8f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:45.509452 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-28a0d853-f54b-4bf0-b2b7-99918fefcd8f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:45.509924 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-28a0d853-f54b-4bf0-b2b7-99918fefcd8f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:45.510676 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-28a0d853-f54b-4bf0-b2b7-99918fefcd8f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:45.511105 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-28a0d853-f54b-4bf0-b2b7-99918fefcd8f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:45.528763 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell1:SELECT=100 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:32:45.536436 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-28a0d853-f54b-4bf0-b2b7-99918fefcd8f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9/ips" status: 200 len: 151 microversion: 2.20 time: 0.038405 Jun 30 18:32:45.537029 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 301/594] 10.222.0.33 () {60 vars in 1288 bytes} [Thu Jun 30 18:32:45 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 18:32:47.370689 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-941f06f1-0d9a-4265-a255-a4fec1972357 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:32:47.371295 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-941f06f1-0d9a-4265-a255-a4fec1972357 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:47.377433 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-941f06f1-0d9a-4265-a255-a4fec1972357 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:47.377907 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-941f06f1-0d9a-4265-a255-a4fec1972357 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:47.378656 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-941f06f1-0d9a-4265-a255-a4fec1972357 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:47.379085 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-941f06f1-0d9a-4265-a255-a4fec1972357 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:47.397469 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:32:47.403309 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.objects.instance [None req-941f06f1-0d9a-4265-a255-a4fec1972357 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lazy-loading 'flavor' on Instance uuid 85c4025a-1510-4b69-a54e-94c9864064b9 {{(pid=117940) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 18:32:47.670356 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-941f06f1-0d9a-4265-a255-a4fec1972357 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "POST /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9/action" status: 202 len: 0 microversion: 2.20 time: 0.304405 Jun 30 18:32:47.671044 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 294/595] 10.222.0.33 () {62 vars in 1318 bytes} [Thu Jun 30 18:32:47 2022] POST /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 30 18:32:47.679411 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-82d853c0-14a9-4417-be96-6cd135c20ba3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:47.680023 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-82d853c0-14a9-4417-be96-6cd135c20ba3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:47.686677 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-82d853c0-14a9-4417-be96-6cd135c20ba3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:47.687135 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-82d853c0-14a9-4417-be96-6cd135c20ba3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:47.688000 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-82d853c0-14a9-4417-be96-6cd135c20ba3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:47.688463 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-82d853c0-14a9-4417-be96-6cd135c20ba3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:47.818640 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-82d853c0-14a9-4417-be96-6cd135c20ba3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:47.826659 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-82d853c0-14a9-4417-be96-6cd135c20ba3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:47.828180 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-82d853c0-14a9-4417-be96-6cd135c20ba3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:47.829321 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-82d853c0-14a9-4417-be96-6cd135c20ba3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1723 microversion: 2.20 time: 0.154063 Jun 30 18:32:47.829913 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 302/596] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:32:47 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:32:48.850287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-44b2a124-dc66-4510-a876-141f7151710b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:48.850976 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-44b2a124-dc66-4510-a876-141f7151710b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:48.857217 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-44b2a124-dc66-4510-a876-141f7151710b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:48.857701 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-44b2a124-dc66-4510-a876-141f7151710b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:48.858453 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-44b2a124-dc66-4510-a876-141f7151710b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:48.858883 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-44b2a124-dc66-4510-a876-141f7151710b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:48.990057 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-44b2a124-dc66-4510-a876-141f7151710b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:48.997865 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-44b2a124-dc66-4510-a876-141f7151710b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:48.999366 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-44b2a124-dc66-4510-a876-141f7151710b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:49.000513 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-44b2a124-dc66-4510-a876-141f7151710b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1723 microversion: 2.20 time: 0.155998 Jun 30 18:32:49.001064 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 295/597] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:32:48 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:32:50.019522 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-48d93074-7ed6-45f3-822b-bef8ff31655a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:50.020696 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-48d93074-7ed6-45f3-822b-bef8ff31655a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:50.027589 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-48d93074-7ed6-45f3-822b-bef8ff31655a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:50.028134 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-48d93074-7ed6-45f3-822b-bef8ff31655a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:50.028791 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-48d93074-7ed6-45f3-822b-bef8ff31655a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:50.029219 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-48d93074-7ed6-45f3-822b-bef8ff31655a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:50.157110 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-48d93074-7ed6-45f3-822b-bef8ff31655a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:50.165627 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-48d93074-7ed6-45f3-822b-bef8ff31655a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:50.167132 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-48d93074-7ed6-45f3-822b-bef8ff31655a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:50.168276 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-48d93074-7ed6-45f3-822b-bef8ff31655a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1723 microversion: 2.20 time: 0.152687 Jun 30 18:32:50.168855 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 303/598] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:32:50 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:32:51.188686 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-2a6ae713-d53f-47a4-af96-38f29c3e6560 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:51.189401 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-2a6ae713-d53f-47a4-af96-38f29c3e6560 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:51.197285 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-2a6ae713-d53f-47a4-af96-38f29c3e6560 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:51.198086 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-2a6ae713-d53f-47a4-af96-38f29c3e6560 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:51.198935 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-2a6ae713-d53f-47a4-af96-38f29c3e6560 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:51.199373 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-2a6ae713-d53f-47a4-af96-38f29c3e6560 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:51.342815 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-2a6ae713-d53f-47a4-af96-38f29c3e6560 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:51.352052 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-2a6ae713-d53f-47a4-af96-38f29c3e6560 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:51.353532 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-2a6ae713-d53f-47a4-af96-38f29c3e6560 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:51.354733 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-2a6ae713-d53f-47a4-af96-38f29c3e6560 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1723 microversion: 2.20 time: 0.171607 Jun 30 18:32:51.355307 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 296/599] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:32:51 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:32:52.373025 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-398516e9-2d76-4e7d-a3a3-e4488ea61ec2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:52.373649 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-398516e9-2d76-4e7d-a3a3-e4488ea61ec2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:52.380788 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-398516e9-2d76-4e7d-a3a3-e4488ea61ec2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:52.381231 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-398516e9-2d76-4e7d-a3a3-e4488ea61ec2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:52.382035 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-398516e9-2d76-4e7d-a3a3-e4488ea61ec2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:52.382470 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-398516e9-2d76-4e7d-a3a3-e4488ea61ec2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:52.511090 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-398516e9-2d76-4e7d-a3a3-e4488ea61ec2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:52.519686 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-398516e9-2d76-4e7d-a3a3-e4488ea61ec2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:52.521170 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-398516e9-2d76-4e7d-a3a3-e4488ea61ec2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:52.522509 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-398516e9-2d76-4e7d-a3a3-e4488ea61ec2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1723 microversion: 2.20 time: 0.153358 Jun 30 18:32:52.523058 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 304/600] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:32:52 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:32:53.540796 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-d83aa405-6163-464e-9d4d-9488489a2047 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:53.541378 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-d83aa405-6163-464e-9d4d-9488489a2047 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:53.547915 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d83aa405-6163-464e-9d4d-9488489a2047 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:53.548356 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d83aa405-6163-464e-9d4d-9488489a2047 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:53.549107 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d83aa405-6163-464e-9d4d-9488489a2047 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:53.549543 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d83aa405-6163-464e-9d4d-9488489a2047 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:53.679432 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-d83aa405-6163-464e-9d4d-9488489a2047 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:53.688118 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-d83aa405-6163-464e-9d4d-9488489a2047 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:53.689624 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-d83aa405-6163-464e-9d4d-9488489a2047 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:53.690772 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-d83aa405-6163-464e-9d4d-9488489a2047 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1723 microversion: 2.20 time: 0.153883 Jun 30 18:32:53.691321 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 297/601] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:32:53 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:32:54.710152 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-40723cd9-e089-4a9d-92d1-68051147ab3d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:54.710781 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-40723cd9-e089-4a9d-92d1-68051147ab3d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:54.713110 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_api:SELECT=44 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:32:54.718683 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-40723cd9-e089-4a9d-92d1-68051147ab3d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:54.719125 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-40723cd9-e089-4a9d-92d1-68051147ab3d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:54.719873 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-40723cd9-e089-4a9d-92d1-68051147ab3d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:54.720299 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-40723cd9-e089-4a9d-92d1-68051147ab3d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:54.857019 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-40723cd9-e089-4a9d-92d1-68051147ab3d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:54.865479 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-40723cd9-e089-4a9d-92d1-68051147ab3d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:54.867119 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-40723cd9-e089-4a9d-92d1-68051147ab3d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:54.868390 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-40723cd9-e089-4a9d-92d1-68051147ab3d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1723 microversion: 2.20 time: 0.163048 Jun 30 18:32:54.868979 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 305/602] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:32:54 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:32:55.886830 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-5658141e-aed8-4ab5-ae82-3cd5bdaa2f66 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:55.887410 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-5658141e-aed8-4ab5-ae82-3cd5bdaa2f66 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:55.893823 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5658141e-aed8-4ab5-ae82-3cd5bdaa2f66 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:55.894258 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5658141e-aed8-4ab5-ae82-3cd5bdaa2f66 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:55.894995 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5658141e-aed8-4ab5-ae82-3cd5bdaa2f66 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:55.895419 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5658141e-aed8-4ab5-ae82-3cd5bdaa2f66 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:56.024289 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-5658141e-aed8-4ab5-ae82-3cd5bdaa2f66 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:56.032199 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-5658141e-aed8-4ab5-ae82-3cd5bdaa2f66 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:56.033721 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-5658141e-aed8-4ab5-ae82-3cd5bdaa2f66 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:56.034869 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-5658141e-aed8-4ab5-ae82-3cd5bdaa2f66 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1723 microversion: 2.20 time: 0.151886 Jun 30 18:32:56.035416 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 298/603] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:32:55 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:32:57.054359 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-eca6e124-772a-4e69-aa54-35ff885c5cea tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:57.055792 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-eca6e124-772a-4e69-aa54-35ff885c5cea tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:57.062258 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-eca6e124-772a-4e69-aa54-35ff885c5cea tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:57.062700 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-eca6e124-772a-4e69-aa54-35ff885c5cea tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:57.063459 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-eca6e124-772a-4e69-aa54-35ff885c5cea tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:57.063948 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-eca6e124-772a-4e69-aa54-35ff885c5cea tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:57.197631 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-eca6e124-772a-4e69-aa54-35ff885c5cea tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:57.205747 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-eca6e124-772a-4e69-aa54-35ff885c5cea tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:57.207242 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-eca6e124-772a-4e69-aa54-35ff885c5cea tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:57.208390 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-eca6e124-772a-4e69-aa54-35ff885c5cea tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1723 microversion: 2.20 time: 0.157969 Jun 30 18:32:57.208950 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 306/604] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:32:57 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:32:58.227580 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-63d1f400-1dae-4e54-9227-d26460c4f180 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:58.228304 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-63d1f400-1dae-4e54-9227-d26460c4f180 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:58.234601 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-63d1f400-1dae-4e54-9227-d26460c4f180 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:58.235044 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-63d1f400-1dae-4e54-9227-d26460c4f180 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:58.235786 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-63d1f400-1dae-4e54-9227-d26460c4f180 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:58.236210 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-63d1f400-1dae-4e54-9227-d26460c4f180 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:58.368347 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-63d1f400-1dae-4e54-9227-d26460c4f180 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:58.376037 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-63d1f400-1dae-4e54-9227-d26460c4f180 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:58.377514 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-63d1f400-1dae-4e54-9227-d26460c4f180 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:58.378686 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-63d1f400-1dae-4e54-9227-d26460c4f180 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1723 microversion: 2.20 time: 0.155575 Jun 30 18:32:58.379238 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 299/605] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:32:58 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:32:59.396526 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-aa313770-0ad9-4e1e-851d-348467d7a304 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:59.397042 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-aa313770-0ad9-4e1e-851d-348467d7a304 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:59.403474 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-aa313770-0ad9-4e1e-851d-348467d7a304 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:59.403933 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-aa313770-0ad9-4e1e-851d-348467d7a304 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:59.404650 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-aa313770-0ad9-4e1e-851d-348467d7a304 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:59.405066 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-aa313770-0ad9-4e1e-851d-348467d7a304 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:59.536787 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-aa313770-0ad9-4e1e-851d-348467d7a304 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:59.545396 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-aa313770-0ad9-4e1e-851d-348467d7a304 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:59.546953 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-aa313770-0ad9-4e1e-851d-348467d7a304 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:59.548102 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-aa313770-0ad9-4e1e-851d-348467d7a304 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1723 microversion: 2.20 time: 0.155537 Jun 30 18:32:59.548666 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 307/606] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:32:59 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:33:00.567724 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-9a2ff65a-5e8b-4416-9b0f-8109d074451d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:00.568327 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-9a2ff65a-5e8b-4416-9b0f-8109d074451d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:00.577748 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9a2ff65a-5e8b-4416-9b0f-8109d074451d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:00.578198 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9a2ff65a-5e8b-4416-9b0f-8109d074451d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:00.578961 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9a2ff65a-5e8b-4416-9b0f-8109d074451d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:00.579394 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9a2ff65a-5e8b-4416-9b0f-8109d074451d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:00.709061 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-9a2ff65a-5e8b-4416-9b0f-8109d074451d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:00.717652 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-9a2ff65a-5e8b-4416-9b0f-8109d074451d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:00.719139 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-9a2ff65a-5e8b-4416-9b0f-8109d074451d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:00.720275 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-9a2ff65a-5e8b-4416-9b0f-8109d074451d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1723 microversion: 2.20 time: 0.156606 Jun 30 18:33:00.720827 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 300/607] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:33:00 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:33:01.739536 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-e7a10b07-a8e7-45a2-9adb-9c52c01fe700 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:01.740144 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-e7a10b07-a8e7-45a2-9adb-9c52c01fe700 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:01.746822 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e7a10b07-a8e7-45a2-9adb-9c52c01fe700 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:01.747267 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e7a10b07-a8e7-45a2-9adb-9c52c01fe700 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:01.748022 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e7a10b07-a8e7-45a2-9adb-9c52c01fe700 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:01.748449 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e7a10b07-a8e7-45a2-9adb-9c52c01fe700 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:01.883449 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-e7a10b07-a8e7-45a2-9adb-9c52c01fe700 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:01.891310 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-e7a10b07-a8e7-45a2-9adb-9c52c01fe700 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:01.892778 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-e7a10b07-a8e7-45a2-9adb-9c52c01fe700 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:01.893942 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-e7a10b07-a8e7-45a2-9adb-9c52c01fe700 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1723 microversion: 2.20 time: 0.158242 Jun 30 18:33:01.894500 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 308/608] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:33:01 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 18:33:02.913019 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-3b5916af-546e-41bd-9445-e3c5e6ad8130 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:02.913649 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-3b5916af-546e-41bd-9445-e3c5e6ad8130 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:02.921194 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3b5916af-546e-41bd-9445-e3c5e6ad8130 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:02.921701 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3b5916af-546e-41bd-9445-e3c5e6ad8130 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:02.922452 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3b5916af-546e-41bd-9445-e3c5e6ad8130 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:02.922884 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3b5916af-546e-41bd-9445-e3c5e6ad8130 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:03.064294 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-3b5916af-546e-41bd-9445-e3c5e6ad8130 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:03.072268 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-3b5916af-546e-41bd-9445-e3c5e6ad8130 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:03.074122 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-3b5916af-546e-41bd-9445-e3c5e6ad8130 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:03.075261 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-3b5916af-546e-41bd-9445-e3c5e6ad8130 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1723 microversion: 2.20 time: 0.166119 Jun 30 18:33:03.075835 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 301/609] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:33:02 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:33:04.094143 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-2d266a4a-5584-4a6e-9d63-10a76efcb089 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:04.094722 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-2d266a4a-5584-4a6e-9d63-10a76efcb089 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:04.101162 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2d266a4a-5584-4a6e-9d63-10a76efcb089 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:04.101637 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2d266a4a-5584-4a6e-9d63-10a76efcb089 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:04.102390 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2d266a4a-5584-4a6e-9d63-10a76efcb089 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:04.102817 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2d266a4a-5584-4a6e-9d63-10a76efcb089 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:04.234865 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-2d266a4a-5584-4a6e-9d63-10a76efcb089 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:04.248383 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-2d266a4a-5584-4a6e-9d63-10a76efcb089 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:04.249942 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-2d266a4a-5584-4a6e-9d63-10a76efcb089 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:04.251113 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-2d266a4a-5584-4a6e-9d63-10a76efcb089 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1723 microversion: 2.20 time: 0.161062 Jun 30 18:33:04.251673 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 309/610] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:33:04 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:33:05.269996 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-21cdd731-e9e6-4492-96ea-bdd6815cfdde tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:05.270605 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-21cdd731-e9e6-4492-96ea-bdd6815cfdde tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:05.278210 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-21cdd731-e9e6-4492-96ea-bdd6815cfdde tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:05.278585 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-21cdd731-e9e6-4492-96ea-bdd6815cfdde tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:05.279333 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-21cdd731-e9e6-4492-96ea-bdd6815cfdde tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:05.279753 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-21cdd731-e9e6-4492-96ea-bdd6815cfdde tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:05.415385 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-21cdd731-e9e6-4492-96ea-bdd6815cfdde tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:05.423339 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-21cdd731-e9e6-4492-96ea-bdd6815cfdde tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:05.424823 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-21cdd731-e9e6-4492-96ea-bdd6815cfdde tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:05.426003 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-21cdd731-e9e6-4492-96ea-bdd6815cfdde tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1723 microversion: 2.20 time: 0.160273 Jun 30 18:33:05.426599 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 302/611] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:33:05 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:33:06.444430 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-1345fcfb-05ad-4548-accc-0f975e4e52a2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:06.444945 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-1345fcfb-05ad-4548-accc-0f975e4e52a2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:06.452135 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1345fcfb-05ad-4548-accc-0f975e4e52a2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:06.452564 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1345fcfb-05ad-4548-accc-0f975e4e52a2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:06.453304 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1345fcfb-05ad-4548-accc-0f975e4e52a2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:06.453768 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1345fcfb-05ad-4548-accc-0f975e4e52a2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:06.582049 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-1345fcfb-05ad-4548-accc-0f975e4e52a2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:06.590380 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-1345fcfb-05ad-4548-accc-0f975e4e52a2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:06.591885 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-1345fcfb-05ad-4548-accc-0f975e4e52a2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:06.593025 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-1345fcfb-05ad-4548-accc-0f975e4e52a2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1723 microversion: 2.20 time: 0.152730 Jun 30 18:33:06.593590 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 310/612] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:33:06 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:33:07.096148 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-0cd76573-b4ae-48f9-837b-e17378f76dcb tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:07.096694 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-0cd76573-b4ae-48f9-837b-e17378f76dcb tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: 19968286-a102-4460-b41d-b98768d61ba4] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:07.102991 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0cd76573-b4ae-48f9-837b-e17378f76dcb tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:07.103426 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0cd76573-b4ae-48f9-837b-e17378f76dcb tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:07.104164 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0cd76573-b4ae-48f9-837b-e17378f76dcb tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:07.104670 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0cd76573-b4ae-48f9-837b-e17378f76dcb tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:07.183279 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.objects.instance [None req-0cd76573-b4ae-48f9-837b-e17378f76dcb tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lazy-loading 'services' on Instance uuid 19968286-a102-4460-b41d-b98768d61ba4 {{(pid=117940) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 18:33:07.256223 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-0cd76573-b4ae-48f9-837b-e17378f76dcb tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "DELETE /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4/os-volume_attachments/b0d37ead-a008-43d0-bf56-37bb591e4021" status: 202 len: 0 microversion: 2.1 time: 0.163695 Jun 30 18:33:07.256843 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 303/613] 10.222.0.33 () {58 vars in 1415 bytes} [Thu Jun 30 18:33:07 2022] DELETE /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4/os-volume_attachments/b0d37ead-a008-43d0-bf56-37bb591e4021 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 18:33:07.611018 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-fa528279-8585-4a3a-b40a-702fae62f700 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:07.611621 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-fa528279-8585-4a3a-b40a-702fae62f700 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:07.617775 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fa528279-8585-4a3a-b40a-702fae62f700 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:07.618225 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fa528279-8585-4a3a-b40a-702fae62f700 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:07.618974 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fa528279-8585-4a3a-b40a-702fae62f700 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:07.619406 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fa528279-8585-4a3a-b40a-702fae62f700 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:07.751318 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-fa528279-8585-4a3a-b40a-702fae62f700 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:07.759234 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-fa528279-8585-4a3a-b40a-702fae62f700 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:07.760722 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-fa528279-8585-4a3a-b40a-702fae62f700 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:07.761903 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-fa528279-8585-4a3a-b40a-702fae62f700 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1723 microversion: 2.20 time: 0.154816 Jun 30 18:33:07.762455 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 311/614] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:33:07 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:33:08.781030 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-50260732-4458-41a3-a18f-1430ac1eeb4d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:08.781754 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-50260732-4458-41a3-a18f-1430ac1eeb4d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:08.787784 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-50260732-4458-41a3-a18f-1430ac1eeb4d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:08.788222 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-50260732-4458-41a3-a18f-1430ac1eeb4d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:08.788967 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-50260732-4458-41a3-a18f-1430ac1eeb4d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:08.789392 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-50260732-4458-41a3-a18f-1430ac1eeb4d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:08.919565 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-50260732-4458-41a3-a18f-1430ac1eeb4d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:08.927354 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-50260732-4458-41a3-a18f-1430ac1eeb4d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:08.928853 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-50260732-4458-41a3-a18f-1430ac1eeb4d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:08.930023 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-50260732-4458-41a3-a18f-1430ac1eeb4d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1723 microversion: 2.20 time: 0.153688 Jun 30 18:33:08.930574 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 304/615] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:33:08 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:33:09.431549 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-f5c38d80-85c6-45cf-87e8-ed6782658860 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:09.432073 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-f5c38d80-85c6-45cf-87e8-ed6782658860 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: 19968286-a102-4460-b41d-b98768d61ba4] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:09.439612 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f5c38d80-85c6-45cf-87e8-ed6782658860 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:09.440051 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f5c38d80-85c6-45cf-87e8-ed6782658860 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:09.440799 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f5c38d80-85c6-45cf-87e8-ed6782658860 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:09.441223 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f5c38d80-85c6-45cf-87e8-ed6782658860 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:09.468061 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-f5c38d80-85c6-45cf-87e8-ed6782658860 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: 19968286-a102-4460-b41d-b98768d61ba4] Going to try to terminate instance {{(pid=117941) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 18:33:09.544314 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-f5c38d80-85c6-45cf-87e8-ed6782658860 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "DELETE /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4" status: 204 len: 0 microversion: 2.1 time: 0.115206 Jun 30 18:33:09.545176 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 312/616] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 30 18:33:09 2022] DELETE /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 18:33:09.553097 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-c0dde6f6-7cbb-499a-a82f-38ba2cd37ce4 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:09.553851 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-c0dde6f6-7cbb-499a-a82f-38ba2cd37ce4 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: 19968286-a102-4460-b41d-b98768d61ba4] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:09.556042 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_api:SELECT=32 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:33:09.563701 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c0dde6f6-7cbb-499a-a82f-38ba2cd37ce4 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:09.564172 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c0dde6f6-7cbb-499a-a82f-38ba2cd37ce4 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:09.564919 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c0dde6f6-7cbb-499a-a82f-38ba2cd37ce4 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:09.565355 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c0dde6f6-7cbb-499a-a82f-38ba2cd37ce4 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:09.698097 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-c0dde6f6-7cbb-499a-a82f-38ba2cd37ce4 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:09.706491 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-c0dde6f6-7cbb-499a-a82f-38ba2cd37ce4 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4" status: 200 len: 1512 microversion: 2.1 time: 0.157243 Jun 30 18:33:09.707057 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 305/617] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:33:09 2022] GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4 => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:33:09.949627 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-42cf78af-6e31-4cf6-9055-8d5dec4def59 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:09.950251 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-42cf78af-6e31-4cf6-9055-8d5dec4def59 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:09.956194 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-42cf78af-6e31-4cf6-9055-8d5dec4def59 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:09.956640 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-42cf78af-6e31-4cf6-9055-8d5dec4def59 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:09.957395 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-42cf78af-6e31-4cf6-9055-8d5dec4def59 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:09.957860 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-42cf78af-6e31-4cf6-9055-8d5dec4def59 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:10.087295 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-42cf78af-6e31-4cf6-9055-8d5dec4def59 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:10.095117 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-42cf78af-6e31-4cf6-9055-8d5dec4def59 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:10.096645 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-42cf78af-6e31-4cf6-9055-8d5dec4def59 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:10.097863 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-42cf78af-6e31-4cf6-9055-8d5dec4def59 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1744 microversion: 2.20 time: 0.152943 Jun 30 18:33:10.098423 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 313/618] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:33:09 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:33:10.723949 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-520556c5-8fdb-4014-8829-6ce4061dc791 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:10.724575 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-520556c5-8fdb-4014-8829-6ce4061dc791 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: 19968286-a102-4460-b41d-b98768d61ba4] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:10.732298 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-520556c5-8fdb-4014-8829-6ce4061dc791 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:10.732765 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-520556c5-8fdb-4014-8829-6ce4061dc791 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:10.733542 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-520556c5-8fdb-4014-8829-6ce4061dc791 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:10.734006 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-520556c5-8fdb-4014-8829-6ce4061dc791 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:10.862293 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-520556c5-8fdb-4014-8829-6ce4061dc791 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:10.869529 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-520556c5-8fdb-4014-8829-6ce4061dc791 tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4" status: 200 len: 1512 microversion: 2.1 time: 0.149456 Jun 30 18:33:10.870206 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 306/619] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:33:10 2022] GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4 => generated 1512 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:33:11.117368 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-21849637-a68f-47f4-a83f-8720c9f9b12d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:11.117999 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-21849637-a68f-47f4-a83f-8720c9f9b12d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:11.125057 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-21849637-a68f-47f4-a83f-8720c9f9b12d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:11.125498 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-21849637-a68f-47f4-a83f-8720c9f9b12d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:11.126297 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-21849637-a68f-47f4-a83f-8720c9f9b12d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:11.126708 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-21849637-a68f-47f4-a83f-8720c9f9b12d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:11.258802 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-21849637-a68f-47f4-a83f-8720c9f9b12d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:11.267299 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-21849637-a68f-47f4-a83f-8720c9f9b12d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:11.268801 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-21849637-a68f-47f4-a83f-8720c9f9b12d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:11.269972 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-21849637-a68f-47f4-a83f-8720c9f9b12d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1744 microversion: 2.20 time: 0.156725 Jun 30 18:33:11.270533 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 314/620] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:33:11 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:33:11.887903 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-d84a6caa-5574-49ff-bfc0-3bf4d5bfbc5e tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:11.888516 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-d84a6caa-5574-49ff-bfc0-3bf4d5bfbc5e tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: 19968286-a102-4460-b41d-b98768d61ba4] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:11.895182 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d84a6caa-5574-49ff-bfc0-3bf4d5bfbc5e tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:11.895832 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d84a6caa-5574-49ff-bfc0-3bf4d5bfbc5e tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:11.896533 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d84a6caa-5574-49ff-bfc0-3bf4d5bfbc5e tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:11.897690 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d84a6caa-5574-49ff-bfc0-3bf4d5bfbc5e tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:12.126517 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-d84a6caa-5574-49ff-bfc0-3bf4d5bfbc5e tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4128f8b7190e455b8dc599a404e3608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175743f30d314455a3bead1c50750fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:12.133954 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-d84a6caa-5574-49ff-bfc0-3bf4d5bfbc5e tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4" status: 200 len: 1512 microversion: 2.1 time: 0.250445 Jun 30 18:33:12.134527 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 307/621] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:33:11 2022] GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4 => generated 1512 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:33:12.290814 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-3b706890-0305-48f5-ab08-76998c156054 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:12.291632 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-3b706890-0305-48f5-ab08-76998c156054 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:12.306078 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [req-4e149587-6d17-415c-8e91-6a15f2174d4f req-9661725b-c3d2-4635-aab8-03c801c55a88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19968286-a102-4460-b41d-b98768d61ba4", "name": "network-vif-deleted", "tag": "4411c747-aa4a-4d3e-b06a-20aa52b5883c"}]} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:33:12.308319 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3b706890-0305-48f5-ab08-76998c156054 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:12.309838 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3b706890-0305-48f5-ab08-76998c156054 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:12.310722 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3b706890-0305-48f5-ab08-76998c156054 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:12.315527 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3b706890-0305-48f5-ab08-76998c156054 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:12.329341 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-4e149587-6d17-415c-8e91-6a15f2174d4f req-9661725b-c3d2-4635-aab8-03c801c55a88 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:12.329799 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-4e149587-6d17-415c-8e91-6a15f2174d4f req-9661725b-c3d2-4635-aab8-03c801c55a88 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:12.350025 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.compute.server_external_events [req-4e149587-6d17-415c-8e91-6a15f2174d4f req-9661725b-c3d2-4635-aab8-03c801c55a88 service nova] Creating event network-vif-deleted:4411c747-aa4a-4d3e-b06a-20aa52b5883c for instance 19968286-a102-4460-b41d-b98768d61ba4 on hv-cinder-80378 Jun 30 18:33:12.356358 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [req-4e149587-6d17-415c-8e91-6a15f2174d4f req-9661725b-c3d2-4635-aab8-03c801c55a88 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055091 Jun 30 18:33:12.356964 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 308/622] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:33:12.470568 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-3b706890-0305-48f5-ab08-76998c156054 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:12.479192 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-3b706890-0305-48f5-ab08-76998c156054 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:12.481377 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-3b706890-0305-48f5-ab08-76998c156054 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:12.482559 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-3b706890-0305-48f5-ab08-76998c156054 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1744 microversion: 2.20 time: 0.197053 Jun 30 18:33:12.483120 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 315/623] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:33:12 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1744 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:33:13.152643 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-9224b132-db81-4112-b05e-61e3d853130e tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:13.153754 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-9224b132-db81-4112-b05e-61e3d853130e tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] [instance: 19968286-a102-4460-b41d-b98768d61ba4] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:13.160395 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9224b132-db81-4112-b05e-61e3d853130e tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:13.160843 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9224b132-db81-4112-b05e-61e3d853130e tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:13.161617 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9224b132-db81-4112-b05e-61e3d853130e tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:13.162053 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9224b132-db81-4112-b05e-61e3d853130e tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:13.166918 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:33:13.184863 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.wsgi [None req-9224b132-db81-4112-b05e-61e3d853130e tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] HTTP exception thrown: Instance 19968286-a102-4460-b41d-b98768d61ba4 could not be found. Jun 30 18:33:13.186631 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-9224b132-db81-4112-b05e-61e3d853130e tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Request method failure captured: Jun 30 18:33:13.186631 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: request: GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4 HTTP/1.1 Jun 30 18:33:13.186631 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept: application/json Jun 30 18:33:13.186631 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept-Encoding: identity Jun 30 18:33:13.186631 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Connection: close Jun 30 18:33:13.186631 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Length: 0 Jun 30 18:33:13.186631 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Type: application/json Jun 30 18:33:13.186631 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Host: 10.222.0.33 Jun 30 18:33:13.186631 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Openstack-System-Scope: None Jun 30 18:33:13.186631 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: User-Agent: python-urllib3/1.26.9 Jun 30 18:33:13.186631 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Auth-Token: gAAAAABiveuPhvTtAi8Alnh2wJj1pK_EsueiuLvXWC2w9eZB9CQIJS-M9hfleuRkRthgt77Iv7ZB0AfcpZ9D6k_ZMIH_kDTt0pPIC9On9oYar9qZ_qZ-Z828iIPnv0hJSWSf6NdDRh7erlUkyXRZmyO2iqydj6oKum1e9Wmt0MeuYbWSJ4Obb40 Jun 30 18:33:13.186631 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Id: None Jun 30 18:33:13.186631 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Name: None Jun 30 18:33:13.186631 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Identity-Status: Confirmed Jun 30 18:33:13.186631 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Is-Admin-Project: True Jun 30 18:33:13.186631 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Id: default Jun 30 18:33:13.186631 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Name: Default Jun 30 18:33:13.186631 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Id: 175743f30d314455a3bead1c50750fbe Jun 30 18:33:13.186631 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Name: tempest-VolumesSnapshotTestJSON-676990064 Jun 30 18:33:13.186631 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Role: reader,member Jun 30 18:33:13.186631 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Roles: reader,member Jun 30 18:33:13.188054 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/175743f30d314455a3bead1c50750fbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_175743f30d314455a3bead1c50750fbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/175743f30d314455a3bead1c50750fbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/175743f30d314455a3bead1c50750fbe"}]}] Jun 30 18:33:13.188054 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant: tempest-VolumesSnapshotTestJSON-676990064 Jun 30 18:33:13.188054 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Id: 175743f30d314455a3bead1c50750fbe Jun 30 18:33:13.188054 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-676990064 Jun 30 18:33:13.188054 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User: tempest-VolumesSnapshotTestJSON-676990064-project Jun 30 18:33:13.188054 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Id: default Jun 30 18:33:13.188054 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Name: Default Jun 30 18:33:13.188054 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Id: 4128f8b7190e455b8dc599a404e3608c Jun 30 18:33:13.188054 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Name: tempest-VolumesSnapshotTestJSON-676990064-project Jun 30 18:33:13.188054 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: method: > Jun 30 18:33:13.188054 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: exception: Instance 19968286-a102-4460-b41d-b98768d61ba4 could not be found. Jun 30 18:33:13.188054 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: action_args: {'id': '19968286-a102-4460-b41d-b98768d61ba4'} Jun 30 18:33:13.188805 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:33:13.188805 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:33:13.188805 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:33:13.188805 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:33:13.188805 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:33:13.188805 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:33:13.188805 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:33:13.188805 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:33:13.188805 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:33:13.188805 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:33:13.188805 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19968286-a102-4460-b41d-b98768d61ba4 could not be found. Jun 30 18:33:13.188805 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:33:13.188805 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:33:13.188805 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:33:13.188805 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:33:13.188805 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:33:13.188805 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:33:13.188805 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:33:13.188805 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:33:13.188805 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:33:13.190306 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:33:13.190306 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:33:13.190306 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:33:13.190306 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:33:13.190306 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:33:13.190306 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:33:13.190306 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:33:13.190306 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19968286-a102-4460-b41d-b98768d61ba4 could not be found. Jun 30 18:33:13.190306 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:33:13.190306 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:33:13.190306 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:33:13.190306 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:33:13.190306 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:33:13.190306 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:33:13.190306 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:33:13.190306 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:33:13.190306 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19968286-a102-4460-b41d-b98768d61ba4 could not be found. Jun 30 18:33:13.190306 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:33:13.191646 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-9224b132-db81-4112-b05e-61e3d853130e tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] Returning 404 to user: Instance 19968286-a102-4460-b41d-b98768d61ba4 could not be found. {{(pid=117940) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:33:13.191646 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-9224b132-db81-4112-b05e-61e3d853130e tempest-VolumesSnapshotTestJSON-676990064 tempest-VolumesSnapshotTestJSON-676990064-project] 10.222.0.33 "GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4" status: 404 len: 111 microversion: 2.1 time: 0.040220 Jun 30 18:33:13.191646 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 309/624] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:33:13 2022] GET /compute/v2.1/servers/19968286-a102-4460-b41d-b98768d61ba4 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:33:13.502173 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-be5e0c86-ac79-4966-9fea-e5f3f04b5095 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:13.503256 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-be5e0c86-ac79-4966-9fea-e5f3f04b5095 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:13.511038 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-be5e0c86-ac79-4966-9fea-e5f3f04b5095 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:13.511742 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-be5e0c86-ac79-4966-9fea-e5f3f04b5095 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:13.512597 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-be5e0c86-ac79-4966-9fea-e5f3f04b5095 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:13.513016 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-be5e0c86-ac79-4966-9fea-e5f3f04b5095 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:13.648006 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-be5e0c86-ac79-4966-9fea-e5f3f04b5095 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:13.651433 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:33:13.658143 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-be5e0c86-ac79-4966-9fea-e5f3f04b5095 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:13.659633 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-be5e0c86-ac79-4966-9fea-e5f3f04b5095 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:13.660775 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-be5e0c86-ac79-4966-9fea-e5f3f04b5095 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1744 microversion: 2.20 time: 0.163855 Jun 30 18:33:13.661331 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 316/625] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:33:13 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1744 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:33:13.878963 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [req-8a840338-4795-49e9-8ca7-261e46dbd545 req-3a279415-9e85-4d99-ac04-175159de2cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85c4025a-1510-4b69-a54e-94c9864064b9", "name": "network-vif-plugged", "status": "completed", "tag": "82ef2cd7-f1a8-48a7-bd5b-c0babc56b244"}]} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:33:13.889251 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-8a840338-4795-49e9-8ca7-261e46dbd545 req-3a279415-9e85-4d99-ac04-175159de2cb3 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:13.889805 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-8a840338-4795-49e9-8ca7-261e46dbd545 req-3a279415-9e85-4d99-ac04-175159de2cb3 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:13.903744 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.compute.server_external_events [req-8a840338-4795-49e9-8ca7-261e46dbd545 req-3a279415-9e85-4d99-ac04-175159de2cb3 service nova] Creating event network-vif-plugged:82ef2cd7-f1a8-48a7-bd5b-c0babc56b244 for instance 85c4025a-1510-4b69-a54e-94c9864064b9 on hv-cinder-80378 Jun 30 18:33:13.909079 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [req-8a840338-4795-49e9-8ca7-261e46dbd545 req-3a279415-9e85-4d99-ac04-175159de2cb3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033427 Jun 30 18:33:13.909706 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 310/626] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:33:14.680131 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-a28a4980-5829-42fe-af7b-fe55fe1b23b4 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:14.680927 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-a28a4980-5829-42fe-af7b-fe55fe1b23b4 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:14.688910 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a28a4980-5829-42fe-af7b-fe55fe1b23b4 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:14.689516 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a28a4980-5829-42fe-af7b-fe55fe1b23b4 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:14.690285 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a28a4980-5829-42fe-af7b-fe55fe1b23b4 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:14.690707 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a28a4980-5829-42fe-af7b-fe55fe1b23b4 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:14.834283 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-a28a4980-5829-42fe-af7b-fe55fe1b23b4 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:14.845133 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-a28a4980-5829-42fe-af7b-fe55fe1b23b4 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:14.847060 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-a28a4980-5829-42fe-af7b-fe55fe1b23b4 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:14.848536 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-a28a4980-5829-42fe-af7b-fe55fe1b23b4 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1744 microversion: 2.20 time: 0.173406 Jun 30 18:33:14.849094 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 317/627] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:33:14 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1744 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:33:15.868323 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-a597de5c-7de1-4c5d-9942-1c22f72b5a7c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:15.868967 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-a597de5c-7de1-4c5d-9942-1c22f72b5a7c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:15.875740 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a597de5c-7de1-4c5d-9942-1c22f72b5a7c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:15.876187 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a597de5c-7de1-4c5d-9942-1c22f72b5a7c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:15.876940 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a597de5c-7de1-4c5d-9942-1c22f72b5a7c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:15.877375 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a597de5c-7de1-4c5d-9942-1c22f72b5a7c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:16.010280 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-a597de5c-7de1-4c5d-9942-1c22f72b5a7c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:16.018919 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-a597de5c-7de1-4c5d-9942-1c22f72b5a7c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:16.020395 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-a597de5c-7de1-4c5d-9942-1c22f72b5a7c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:16.021537 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-a597de5c-7de1-4c5d-9942-1c22f72b5a7c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1744 microversion: 2.20 time: 0.157638 Jun 30 18:33:16.022113 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 311/628] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:33:15 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:33:17.040539 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-a003d79c-6977-4f3b-be93-37ecb0b03f52 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:17.041127 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-a003d79c-6977-4f3b-be93-37ecb0b03f52 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:17.048283 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a003d79c-6977-4f3b-be93-37ecb0b03f52 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:17.048715 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a003d79c-6977-4f3b-be93-37ecb0b03f52 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:17.049451 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a003d79c-6977-4f3b-be93-37ecb0b03f52 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:17.049903 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a003d79c-6977-4f3b-be93-37ecb0b03f52 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:17.176194 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-a003d79c-6977-4f3b-be93-37ecb0b03f52 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:17.184229 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-a003d79c-6977-4f3b-be93-37ecb0b03f52 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:17.186885 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-a003d79c-6977-4f3b-be93-37ecb0b03f52 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:17.187684 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-a003d79c-6977-4f3b-be93-37ecb0b03f52 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1744 microversion: 2.20 time: 0.150884 Jun 30 18:33:17.188355 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 318/629] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:33:17 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1744 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:33:18.206205 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-597806ca-9d93-4312-b339-9fd9740d7449 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:18.206845 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-597806ca-9d93-4312-b339-9fd9740d7449 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:18.213309 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-597806ca-9d93-4312-b339-9fd9740d7449 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:18.213796 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-597806ca-9d93-4312-b339-9fd9740d7449 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:18.215246 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-597806ca-9d93-4312-b339-9fd9740d7449 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:18.215720 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-597806ca-9d93-4312-b339-9fd9740d7449 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:18.344560 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-597806ca-9d93-4312-b339-9fd9740d7449 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:18.352383 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-597806ca-9d93-4312-b339-9fd9740d7449 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:18.353904 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-597806ca-9d93-4312-b339-9fd9740d7449 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:18.355060 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-597806ca-9d93-4312-b339-9fd9740d7449 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1744 microversion: 2.20 time: 0.152701 Jun 30 18:33:18.355638 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 312/630] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:33:18 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:33:19.375556 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-8e3e3ee6-6656-43b8-a582-3c49136c8c84 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:19.376248 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-8e3e3ee6-6656-43b8-a582-3c49136c8c84 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:19.383494 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8e3e3ee6-6656-43b8-a582-3c49136c8c84 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:19.384572 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8e3e3ee6-6656-43b8-a582-3c49136c8c84 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:19.386655 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8e3e3ee6-6656-43b8-a582-3c49136c8c84 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:19.387332 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8e3e3ee6-6656-43b8-a582-3c49136c8c84 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:19.529608 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-8e3e3ee6-6656-43b8-a582-3c49136c8c84 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:19.537783 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-8e3e3ee6-6656-43b8-a582-3c49136c8c84 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:19.539281 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-8e3e3ee6-6656-43b8-a582-3c49136c8c84 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:19.540867 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-8e3e3ee6-6656-43b8-a582-3c49136c8c84 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1744 microversion: 2.20 time: 0.170398 Jun 30 18:33:19.541729 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 319/631] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:33:19 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1744 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:33:20.559583 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-10ff7292-d25a-4b7a-8d87-f59b5034fb8c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:20.560187 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-10ff7292-d25a-4b7a-8d87-f59b5034fb8c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:20.566631 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-10ff7292-d25a-4b7a-8d87-f59b5034fb8c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:20.567078 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-10ff7292-d25a-4b7a-8d87-f59b5034fb8c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:20.567835 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-10ff7292-d25a-4b7a-8d87-f59b5034fb8c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:20.568272 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-10ff7292-d25a-4b7a-8d87-f59b5034fb8c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:20.697551 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-10ff7292-d25a-4b7a-8d87-f59b5034fb8c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:20.706496 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-10ff7292-d25a-4b7a-8d87-f59b5034fb8c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:20.707973 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-10ff7292-d25a-4b7a-8d87-f59b5034fb8c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:20.709131 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-10ff7292-d25a-4b7a-8d87-f59b5034fb8c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1744 microversion: 2.20 time: 0.153650 Jun 30 18:33:20.709908 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 313/632] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:33:20 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:33:21.727561 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-29dbd060-63a1-4259-82cd-22bb66a106c3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:21.728155 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-29dbd060-63a1-4259-82cd-22bb66a106c3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:21.736053 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-29dbd060-63a1-4259-82cd-22bb66a106c3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:21.736545 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-29dbd060-63a1-4259-82cd-22bb66a106c3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:21.737287 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-29dbd060-63a1-4259-82cd-22bb66a106c3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:21.737741 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-29dbd060-63a1-4259-82cd-22bb66a106c3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:21.878698 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-29dbd060-63a1-4259-82cd-22bb66a106c3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:21.887069 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-29dbd060-63a1-4259-82cd-22bb66a106c3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:21.889031 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-29dbd060-63a1-4259-82cd-22bb66a106c3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:21.890242 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-29dbd060-63a1-4259-82cd-22bb66a106c3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1739 microversion: 2.20 time: 0.166804 Jun 30 18:33:21.890857 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 320/633] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:33:21 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:33:22.910724 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-0a61548c-e04c-4733-81e6-50a8ac6fa71b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:22.912051 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-0a61548c-e04c-4733-81e6-50a8ac6fa71b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:22.919366 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0a61548c-e04c-4733-81e6-50a8ac6fa71b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:22.919885 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0a61548c-e04c-4733-81e6-50a8ac6fa71b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:22.920674 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0a61548c-e04c-4733-81e6-50a8ac6fa71b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:22.921110 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0a61548c-e04c-4733-81e6-50a8ac6fa71b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:23.057350 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-0a61548c-e04c-4733-81e6-50a8ac6fa71b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:23.066028 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-0a61548c-e04c-4733-81e6-50a8ac6fa71b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:23.067550 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-0a61548c-e04c-4733-81e6-50a8ac6fa71b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:23.068713 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-0a61548c-e04c-4733-81e6-50a8ac6fa71b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1739 microversion: 2.20 time: 0.161886 Jun 30 18:33:23.069533 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 314/634] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:33:22 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1739 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:33:24.088139 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-78e59c21-cac1-48ac-b877-a2a5a162cee0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:24.088856 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-78e59c21-cac1-48ac-b877-a2a5a162cee0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:24.098691 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-78e59c21-cac1-48ac-b877-a2a5a162cee0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:24.099205 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-78e59c21-cac1-48ac-b877-a2a5a162cee0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:24.099972 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-78e59c21-cac1-48ac-b877-a2a5a162cee0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:24.100800 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-78e59c21-cac1-48ac-b877-a2a5a162cee0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:24.304692 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-78e59c21-cac1-48ac-b877-a2a5a162cee0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:24.314078 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-78e59c21-cac1-48ac-b877-a2a5a162cee0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:24.315725 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-78e59c21-cac1-48ac-b877-a2a5a162cee0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:24.317011 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-78e59c21-cac1-48ac-b877-a2a5a162cee0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1739 microversion: 2.20 time: 0.233122 Jun 30 18:33:24.317816 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 321/635] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:33:24 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1739 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:33:25.336022 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-d72f59d8-d4f4-4741-8b23-afae2a9c2d59 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:25.336669 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-d72f59d8-d4f4-4741-8b23-afae2a9c2d59 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:25.343630 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d72f59d8-d4f4-4741-8b23-afae2a9c2d59 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:25.344316 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d72f59d8-d4f4-4741-8b23-afae2a9c2d59 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:25.345285 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d72f59d8-d4f4-4741-8b23-afae2a9c2d59 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:25.345767 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d72f59d8-d4f4-4741-8b23-afae2a9c2d59 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:25.735336 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-d72f59d8-d4f4-4741-8b23-afae2a9c2d59 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:25.745013 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-d72f59d8-d4f4-4741-8b23-afae2a9c2d59 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:25.748502 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-d72f59d8-d4f4-4741-8b23-afae2a9c2d59 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:25.749897 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-d72f59d8-d4f4-4741-8b23-afae2a9c2d59 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1739 microversion: 2.20 time: 0.417656 Jun 30 18:33:25.750989 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 315/636] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:33:25 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1739 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:33:26.768874 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-8d48613f-27f3-4b99-8eea-021b65033019 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:26.769724 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-8d48613f-27f3-4b99-8eea-021b65033019 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:26.774817 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:33:26.783320 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8d48613f-27f3-4b99-8eea-021b65033019 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:26.783839 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8d48613f-27f3-4b99-8eea-021b65033019 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:26.784687 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8d48613f-27f3-4b99-8eea-021b65033019 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:26.785191 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8d48613f-27f3-4b99-8eea-021b65033019 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:26.928376 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-8d48613f-27f3-4b99-8eea-021b65033019 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:26.937224 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-8d48613f-27f3-4b99-8eea-021b65033019 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:26.938833 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-8d48613f-27f3-4b99-8eea-021b65033019 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:26.940200 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-8d48613f-27f3-4b99-8eea-021b65033019 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1739 microversion: 2.20 time: 0.175293 Jun 30 18:33:26.941051 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 322/637] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:33:26 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1739 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:33:27.959233 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-a855e013-acae-467d-b87f-7d8873045025 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:27.960574 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-a855e013-acae-467d-b87f-7d8873045025 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:27.968148 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a855e013-acae-467d-b87f-7d8873045025 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:27.968820 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a855e013-acae-467d-b87f-7d8873045025 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:27.969638 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a855e013-acae-467d-b87f-7d8873045025 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:27.970076 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a855e013-acae-467d-b87f-7d8873045025 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:28.126175 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-a855e013-acae-467d-b87f-7d8873045025 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:28.135784 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-a855e013-acae-467d-b87f-7d8873045025 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:28.137381 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-a855e013-acae-467d-b87f-7d8873045025 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:28.138647 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-a855e013-acae-467d-b87f-7d8873045025 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1739 microversion: 2.20 time: 0.183712 Jun 30 18:33:28.139575 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 316/638] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:33:27 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 18:33:29.156705 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-4e9ebfe5-34d3-4246-a8ae-24292c9fede1 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:29.157318 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-4e9ebfe5-34d3-4246-a8ae-24292c9fede1 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:29.163703 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-4e9ebfe5-34d3-4246-a8ae-24292c9fede1 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:29.164146 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-4e9ebfe5-34d3-4246-a8ae-24292c9fede1 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:29.164905 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-4e9ebfe5-34d3-4246-a8ae-24292c9fede1 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:29.165338 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-4e9ebfe5-34d3-4246-a8ae-24292c9fede1 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:29.376523 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-4e9ebfe5-34d3-4246-a8ae-24292c9fede1 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:29.384119 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-4e9ebfe5-34d3-4246-a8ae-24292c9fede1 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:29.385664 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-4e9ebfe5-34d3-4246-a8ae-24292c9fede1 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:29.386748 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-4e9ebfe5-34d3-4246-a8ae-24292c9fede1 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1739 microversion: 2.20 time: 0.234514 Jun 30 18:33:29.387288 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 323/639] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:33:29 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1739 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:33:30.417717 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-d7e38eb9-82b8-40f3-bba9-057c9cebb7a7 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:30.418467 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-d7e38eb9-82b8-40f3-bba9-057c9cebb7a7 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:30.425217 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d7e38eb9-82b8-40f3-bba9-057c9cebb7a7 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:30.425779 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d7e38eb9-82b8-40f3-bba9-057c9cebb7a7 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:30.426605 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d7e38eb9-82b8-40f3-bba9-057c9cebb7a7 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:30.427098 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d7e38eb9-82b8-40f3-bba9-057c9cebb7a7 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:30.587446 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-d7e38eb9-82b8-40f3-bba9-057c9cebb7a7 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:30.598045 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-d7e38eb9-82b8-40f3-bba9-057c9cebb7a7 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:30.599556 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-d7e38eb9-82b8-40f3-bba9-057c9cebb7a7 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:30.600662 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-d7e38eb9-82b8-40f3-bba9-057c9cebb7a7 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1739 microversion: 2.20 time: 0.194624 Jun 30 18:33:30.610291 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 317/640] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:33:30 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1739 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:33:31.619817 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-81dc421f-d422-4e4b-b7fa-a21dc3091b61 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:31.620417 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-81dc421f-d422-4e4b-b7fa-a21dc3091b61 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:31.627431 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-81dc421f-d422-4e4b-b7fa-a21dc3091b61 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:31.627876 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-81dc421f-d422-4e4b-b7fa-a21dc3091b61 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:31.628624 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-81dc421f-d422-4e4b-b7fa-a21dc3091b61 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:31.629053 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-81dc421f-d422-4e4b-b7fa-a21dc3091b61 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:31.761875 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-81dc421f-d422-4e4b-b7fa-a21dc3091b61 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:31.769833 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-81dc421f-d422-4e4b-b7fa-a21dc3091b61 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:31.771344 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-81dc421f-d422-4e4b-b7fa-a21dc3091b61 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:31.772496 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-81dc421f-d422-4e4b-b7fa-a21dc3091b61 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1739 microversion: 2.20 time: 0.156618 Jun 30 18:33:31.773054 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 324/641] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:33:31 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1739 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:33:32.790893 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-0b15d4da-9191-4aba-9c0f-c7cfab5e956d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:32.791505 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-0b15d4da-9191-4aba-9c0f-c7cfab5e956d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:32.797971 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0b15d4da-9191-4aba-9c0f-c7cfab5e956d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:32.798421 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0b15d4da-9191-4aba-9c0f-c7cfab5e956d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:32.799190 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0b15d4da-9191-4aba-9c0f-c7cfab5e956d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:32.799627 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0b15d4da-9191-4aba-9c0f-c7cfab5e956d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:33.007353 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-0b15d4da-9191-4aba-9c0f-c7cfab5e956d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:33.015355 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-0b15d4da-9191-4aba-9c0f-c7cfab5e956d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:33.016890 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-0b15d4da-9191-4aba-9c0f-c7cfab5e956d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:33.018098 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-0b15d4da-9191-4aba-9c0f-c7cfab5e956d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1721 microversion: 2.20 time: 0.231181 Jun 30 18:33:33.018652 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 318/642] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:33:32 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1721 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:33:34.037300 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-c7ba6909-6b87-4de1-a218-809a9feb4abc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:34.038009 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-c7ba6909-6b87-4de1-a218-809a9feb4abc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:34.047672 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c7ba6909-6b87-4de1-a218-809a9feb4abc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:34.047672 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c7ba6909-6b87-4de1-a218-809a9feb4abc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:34.047672 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c7ba6909-6b87-4de1-a218-809a9feb4abc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:34.047672 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c7ba6909-6b87-4de1-a218-809a9feb4abc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:34.199795 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-c7ba6909-6b87-4de1-a218-809a9feb4abc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:34.209044 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-c7ba6909-6b87-4de1-a218-809a9feb4abc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:34.210586 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-c7ba6909-6b87-4de1-a218-809a9feb4abc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:34.211806 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-c7ba6909-6b87-4de1-a218-809a9feb4abc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1721 microversion: 2.20 time: 0.178545 Jun 30 18:33:34.212364 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 325/643] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:33:34 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:33:35.337177 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-cbf790fb-9a27-4f1d-a667-474d16ba8bcb tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:35.337806 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-cbf790fb-9a27-4f1d-a667-474d16ba8bcb tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:35.344413 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cbf790fb-9a27-4f1d-a667-474d16ba8bcb tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:35.344862 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cbf790fb-9a27-4f1d-a667-474d16ba8bcb tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:35.345643 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cbf790fb-9a27-4f1d-a667-474d16ba8bcb tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:35.346076 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cbf790fb-9a27-4f1d-a667-474d16ba8bcb tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:35.479266 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-cbf790fb-9a27-4f1d-a667-474d16ba8bcb tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:35.487998 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-cbf790fb-9a27-4f1d-a667-474d16ba8bcb tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:35.489895 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-cbf790fb-9a27-4f1d-a667-474d16ba8bcb tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:35.491034 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-cbf790fb-9a27-4f1d-a667-474d16ba8bcb tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1724 microversion: 2.20 time: 0.264734 Jun 30 18:33:35.491585 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 319/644] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:33:35 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1724 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:33:35.509301 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-2f60126d-129c-475f-9a48-aa75171b8016 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f0fad95b-ead7-4c66-bc67-38b365ae2830"}} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:33:35.510456 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-2f60126d-129c-475f-9a48-aa75171b8016 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:35.516860 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2f60126d-129c-475f-9a48-aa75171b8016 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:35.517419 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2f60126d-129c-475f-9a48-aa75171b8016 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:35.518327 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2f60126d-129c-475f-9a48-aa75171b8016 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:35.518741 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2f60126d-129c-475f-9a48-aa75171b8016 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:35.808701 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-2f60126d-129c-475f-9a48-aa75171b8016 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "POST /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.303074 Jun 30 18:33:35.809311 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 326/645] 10.222.0.33 () {62 vars in 1363 bytes} [Thu Jun 30 18:33:35 2022] POST /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9/os-volume_attachments => generated 188 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 30 18:33:35.941108 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-b93b146b-0d67-4d82-9c26-382207615939 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:33:35.941697 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-b93b146b-0d67-4d82-9c26-382207615939 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:35.947979 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b93b146b-0d67-4d82-9c26-382207615939 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:35.948445 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b93b146b-0d67-4d82-9c26-382207615939 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:35.949184 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b93b146b-0d67-4d82-9c26-382207615939 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:35.949653 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b93b146b-0d67-4d82-9c26-382207615939 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:35.956450 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-a79acb20-f95d-4a9c-8db9-9d0e9e229e7c req-b512f432-300c-4397-9c97-3cbbe499a135 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85c4025a-1510-4b69-a54e-94c9864064b9", "name": "network-vif-unplugged", "status": "completed", "tag": "82ef2cd7-f1a8-48a7-bd5b-c0babc56b244"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:33:35.965949 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-a79acb20-f95d-4a9c-8db9-9d0e9e229e7c req-b512f432-300c-4397-9c97-3cbbe499a135 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:35.966376 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-a79acb20-f95d-4a9c-8db9-9d0e9e229e7c req-b512f432-300c-4397-9c97-3cbbe499a135 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:35.978854 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.compute.server_external_events [req-a79acb20-f95d-4a9c-8db9-9d0e9e229e7c req-b512f432-300c-4397-9c97-3cbbe499a135 service nova] Unable to find a host for instance 85c4025a-1510-4b69-a54e-94c9864064b9. Dropping event network-vif-unplugged {{(pid=117941) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 30 18:33:35.979742 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-a79acb20-f95d-4a9c-8db9-9d0e9e229e7c req-b512f432-300c-4397-9c97-3cbbe499a135 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028435 Jun 30 18:33:35.980493 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 327/646] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 30 18:33:36.090369 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-b93b146b-0d67-4d82-9c26-382207615939 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "POST /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9/action" status: 202 len: 0 microversion: 2.20 time: 0.153092 Jun 30 18:33:36.091090 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 320/647] 10.222.0.33 () {62 vars in 1318 bytes} [Thu Jun 30 18:33:35 2022] POST /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 30 18:33:36.099737 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-c63d8598-0d54-401c-afaf-8772f8def04c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:36.100476 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-c63d8598-0d54-401c-afaf-8772f8def04c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:36.106470 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c63d8598-0d54-401c-afaf-8772f8def04c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:36.106915 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c63d8598-0d54-401c-afaf-8772f8def04c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:36.107670 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c63d8598-0d54-401c-afaf-8772f8def04c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:36.108135 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c63d8598-0d54-401c-afaf-8772f8def04c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:36.254520 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-c63d8598-0d54-401c-afaf-8772f8def04c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:36.265824 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-c63d8598-0d54-401c-afaf-8772f8def04c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:36.268019 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-c63d8598-0d54-401c-afaf-8772f8def04c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:36.269278 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-c63d8598-0d54-401c-afaf-8772f8def04c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1750 microversion: 2.20 time: 0.173462 Jun 30 18:33:36.273769 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 328/648] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:33:36 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1750 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:33:37.288791 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-b040c82f-ab22-46c1-ba8d-22d7031a280a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:37.289390 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-b040c82f-ab22-46c1-ba8d-22d7031a280a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:37.296640 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b040c82f-ab22-46c1-ba8d-22d7031a280a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:37.297250 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b040c82f-ab22-46c1-ba8d-22d7031a280a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:37.298089 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b040c82f-ab22-46c1-ba8d-22d7031a280a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:37.298510 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b040c82f-ab22-46c1-ba8d-22d7031a280a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:37.432161 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-b040c82f-ab22-46c1-ba8d-22d7031a280a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:37.440945 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-b040c82f-ab22-46c1-ba8d-22d7031a280a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:37.442501 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-b040c82f-ab22-46c1-ba8d-22d7031a280a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:37.443634 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-b040c82f-ab22-46c1-ba8d-22d7031a280a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1752 microversion: 2.20 time: 0.158838 Jun 30 18:33:37.444174 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 321/649] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:33:37 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:33:38.462255 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-4b93c805-e4d1-42ed-9518-eadcde3cd13f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:38.462860 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-4b93c805-e4d1-42ed-9518-eadcde3cd13f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:38.469115 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-4b93c805-e4d1-42ed-9518-eadcde3cd13f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:38.469558 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-4b93c805-e4d1-42ed-9518-eadcde3cd13f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:38.470346 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-4b93c805-e4d1-42ed-9518-eadcde3cd13f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:38.471502 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-4b93c805-e4d1-42ed-9518-eadcde3cd13f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:38.670589 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-4b93c805-e4d1-42ed-9518-eadcde3cd13f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:38.681314 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-4b93c805-e4d1-42ed-9518-eadcde3cd13f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:38.682952 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-4b93c805-e4d1-42ed-9518-eadcde3cd13f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:38.684515 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-4b93c805-e4d1-42ed-9518-eadcde3cd13f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1808 microversion: 2.20 time: 0.226141 Jun 30 18:33:38.695233 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 329/650] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:33:38 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1808 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:33:39.705356 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-f407b8fb-4554-448e-9a0d-146cc7b7c49b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:39.706005 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-f407b8fb-4554-448e-9a0d-146cc7b7c49b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:39.708522 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_api:SELECT=36 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:33:39.714927 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f407b8fb-4554-448e-9a0d-146cc7b7c49b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:39.715912 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f407b8fb-4554-448e-9a0d-146cc7b7c49b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:39.717020 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f407b8fb-4554-448e-9a0d-146cc7b7c49b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:39.717632 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f407b8fb-4554-448e-9a0d-146cc7b7c49b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:39.896486 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-f407b8fb-4554-448e-9a0d-146cc7b7c49b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:39.906130 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-f407b8fb-4554-448e-9a0d-146cc7b7c49b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:39.908151 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-f407b8fb-4554-448e-9a0d-146cc7b7c49b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:39.909748 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-f407b8fb-4554-448e-9a0d-146cc7b7c49b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1808 microversion: 2.20 time: 0.208998 Jun 30 18:33:39.910768 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 322/651] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:33:39 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1808 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:33:40.929325 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-32a802ec-7861-4264-8ecd-da788e66797e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:40.930339 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-32a802ec-7861-4264-8ecd-da788e66797e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:40.950791 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-32a802ec-7861-4264-8ecd-da788e66797e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:40.951241 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-32a802ec-7861-4264-8ecd-da788e66797e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:40.952037 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-32a802ec-7861-4264-8ecd-da788e66797e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:40.952468 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-32a802ec-7861-4264-8ecd-da788e66797e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:41.121652 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-32a802ec-7861-4264-8ecd-da788e66797e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:41.131009 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-32a802ec-7861-4264-8ecd-da788e66797e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:41.132878 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-32a802ec-7861-4264-8ecd-da788e66797e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:41.134154 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-32a802ec-7861-4264-8ecd-da788e66797e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1808 microversion: 2.20 time: 0.210080 Jun 30 18:33:41.134982 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 330/652] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:33:40 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1808 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:33:42.153851 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-44577ce8-11e2-4c9d-85af-6b200651d987 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:42.155080 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-44577ce8-11e2-4c9d-85af-6b200651d987 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:42.162123 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-44577ce8-11e2-4c9d-85af-6b200651d987 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:42.162562 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-44577ce8-11e2-4c9d-85af-6b200651d987 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:42.163316 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-44577ce8-11e2-4c9d-85af-6b200651d987 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:42.163742 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-44577ce8-11e2-4c9d-85af-6b200651d987 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:42.334245 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-44577ce8-11e2-4c9d-85af-6b200651d987 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:42.354245 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-44577ce8-11e2-4c9d-85af-6b200651d987 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:42.356056 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-44577ce8-11e2-4c9d-85af-6b200651d987 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:42.357556 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-44577ce8-11e2-4c9d-85af-6b200651d987 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1808 microversion: 2.20 time: 0.208096 Jun 30 18:33:42.360529 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 323/653] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:33:42 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1808 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:33:43.382316 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-f27a230a-b84c-462b-a6ab-f43cfaf0e5f2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:43.383877 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-f27a230a-b84c-462b-a6ab-f43cfaf0e5f2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:43.393432 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f27a230a-b84c-462b-a6ab-f43cfaf0e5f2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:43.394043 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f27a230a-b84c-462b-a6ab-f43cfaf0e5f2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:43.394906 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f27a230a-b84c-462b-a6ab-f43cfaf0e5f2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:43.395439 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f27a230a-b84c-462b-a6ab-f43cfaf0e5f2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:43.421887 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:33:43.641561 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-f27a230a-b84c-462b-a6ab-f43cfaf0e5f2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:43.654811 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-f27a230a-b84c-462b-a6ab-f43cfaf0e5f2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:43.656519 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-f27a230a-b84c-462b-a6ab-f43cfaf0e5f2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:43.657817 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-f27a230a-b84c-462b-a6ab-f43cfaf0e5f2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1808 microversion: 2.20 time: 0.281220 Jun 30 18:33:43.659226 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 331/654] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:33:43 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1808 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:33:44.677215 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-6577cc87-f6c3-45bb-9a33-5a31d8f8dc93 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:44.677812 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-6577cc87-f6c3-45bb-9a33-5a31d8f8dc93 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:44.684779 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6577cc87-f6c3-45bb-9a33-5a31d8f8dc93 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:44.685697 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6577cc87-f6c3-45bb-9a33-5a31d8f8dc93 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:44.686658 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6577cc87-f6c3-45bb-9a33-5a31d8f8dc93 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:44.687258 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6577cc87-f6c3-45bb-9a33-5a31d8f8dc93 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:44.693128 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:33:44.966500 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-6577cc87-f6c3-45bb-9a33-5a31d8f8dc93 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:44.997410 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-6577cc87-f6c3-45bb-9a33-5a31d8f8dc93 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:45.009765 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-6577cc87-f6c3-45bb-9a33-5a31d8f8dc93 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:45.011302 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-6577cc87-f6c3-45bb-9a33-5a31d8f8dc93 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1808 microversion: 2.20 time: 0.338915 Jun 30 18:33:45.014596 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 324/655] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:33:44 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1808 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:33:46.040954 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-fce62280-79c0-4c2e-a067-53722ad79eee tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:46.042712 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-fce62280-79c0-4c2e-a067-53722ad79eee tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:46.062119 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fce62280-79c0-4c2e-a067-53722ad79eee tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:46.063926 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fce62280-79c0-4c2e-a067-53722ad79eee tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:46.066503 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fce62280-79c0-4c2e-a067-53722ad79eee tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:46.067650 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fce62280-79c0-4c2e-a067-53722ad79eee tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:46.270588 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-fce62280-79c0-4c2e-a067-53722ad79eee tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:46.282408 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-fce62280-79c0-4c2e-a067-53722ad79eee tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:46.285911 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-fce62280-79c0-4c2e-a067-53722ad79eee tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:46.287489 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-fce62280-79c0-4c2e-a067-53722ad79eee tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1808 microversion: 2.20 time: 0.254060 Jun 30 18:33:46.288261 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 332/656] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:33:46 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1808 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:33:47.308153 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-fdbe4fbd-b5ad-4bb3-952a-b3703febcb94 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:47.309673 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-fdbe4fbd-b5ad-4bb3-952a-b3703febcb94 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:47.318969 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fdbe4fbd-b5ad-4bb3-952a-b3703febcb94 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:47.320040 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fdbe4fbd-b5ad-4bb3-952a-b3703febcb94 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:47.321043 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fdbe4fbd-b5ad-4bb3-952a-b3703febcb94 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:47.321736 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fdbe4fbd-b5ad-4bb3-952a-b3703febcb94 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:47.572307 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-fdbe4fbd-b5ad-4bb3-952a-b3703febcb94 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:47.611081 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-fdbe4fbd-b5ad-4bb3-952a-b3703febcb94 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:47.616737 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-fdbe4fbd-b5ad-4bb3-952a-b3703febcb94 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:47.619769 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-fdbe4fbd-b5ad-4bb3-952a-b3703febcb94 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1808 microversion: 2.20 time: 0.315334 Jun 30 18:33:47.622665 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 325/657] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:33:47 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1808 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:33:47.800287 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-8da6cad6-ae47-4cfc-84f8-5b063f5eb7c1 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:47.802898 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-8da6cad6-ae47-4cfc-84f8-5b063f5eb7c1 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:47.819283 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8da6cad6-ae47-4cfc-84f8-5b063f5eb7c1 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:47.820283 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8da6cad6-ae47-4cfc-84f8-5b063f5eb7c1 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:47.821332 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8da6cad6-ae47-4cfc-84f8-5b063f5eb7c1 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:47.822053 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8da6cad6-ae47-4cfc-84f8-5b063f5eb7c1 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:47.857164 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-8da6cad6-ae47-4cfc-84f8-5b063f5eb7c1 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d/ips" status: 200 len: 146 microversion: 2.1 time: 0.066404 Jun 30 18:33:47.863329 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 333/658] 10.222.0.33 () {58 vars in 1247 bytes} [Thu Jun 30 18:33:47 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d/ips => generated 146 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:33:48.645525 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-99977db1-b90c-4398-9b3a-a47c5221dc30 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:48.648288 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-99977db1-b90c-4398-9b3a-a47c5221dc30 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:48.665897 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-99977db1-b90c-4398-9b3a-a47c5221dc30 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:48.668161 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-99977db1-b90c-4398-9b3a-a47c5221dc30 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:48.669135 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-99977db1-b90c-4398-9b3a-a47c5221dc30 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:48.670554 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-99977db1-b90c-4398-9b3a-a47c5221dc30 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:48.992819 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-99977db1-b90c-4398-9b3a-a47c5221dc30 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:49.030786 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-99977db1-b90c-4398-9b3a-a47c5221dc30 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:49.032702 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-99977db1-b90c-4398-9b3a-a47c5221dc30 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:49.034442 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-99977db1-b90c-4398-9b3a-a47c5221dc30 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1808 microversion: 2.20 time: 0.395097 Jun 30 18:33:49.041913 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 326/659] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:33:48 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1808 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:33:50.063113 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-b88ac424-f21c-4558-8a3a-b290fc1c914c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:50.065143 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-b88ac424-f21c-4558-8a3a-b290fc1c914c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:50.076712 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b88ac424-f21c-4558-8a3a-b290fc1c914c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:50.077206 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b88ac424-f21c-4558-8a3a-b290fc1c914c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:50.078108 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b88ac424-f21c-4558-8a3a-b290fc1c914c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:50.078951 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b88ac424-f21c-4558-8a3a-b290fc1c914c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:50.343649 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-b88ac424-f21c-4558-8a3a-b290fc1c914c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:50.358698 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-b88ac424-f21c-4558-8a3a-b290fc1c914c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:50.366328 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-b88ac424-f21c-4558-8a3a-b290fc1c914c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:50.367768 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-b88ac424-f21c-4558-8a3a-b290fc1c914c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1808 microversion: 2.20 time: 0.311254 Jun 30 18:33:50.371479 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 334/660] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:33:50 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1808 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 18:33:51.390644 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-3b1ec7b3-9a1c-4bda-b5ed-d3620d1d8b66 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:51.392235 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-3b1ec7b3-9a1c-4bda-b5ed-d3620d1d8b66 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:51.404146 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3b1ec7b3-9a1c-4bda-b5ed-d3620d1d8b66 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:51.404823 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3b1ec7b3-9a1c-4bda-b5ed-d3620d1d8b66 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:51.405812 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3b1ec7b3-9a1c-4bda-b5ed-d3620d1d8b66 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:51.406400 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3b1ec7b3-9a1c-4bda-b5ed-d3620d1d8b66 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:51.772638 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-3b1ec7b3-9a1c-4bda-b5ed-d3620d1d8b66 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:51.789229 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-3b1ec7b3-9a1c-4bda-b5ed-d3620d1d8b66 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:51.791254 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-3b1ec7b3-9a1c-4bda-b5ed-d3620d1d8b66 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:51.792416 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-3b1ec7b3-9a1c-4bda-b5ed-d3620d1d8b66 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1808 microversion: 2.20 time: 0.406832 Jun 30 18:33:51.793540 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 327/661] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:33:51 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1808 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:33:52.122233 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-52b6bae2-a981-4ae6-a451-dcb647203d53 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45d427a9-731d-477d-aa68-a038d74eb318"}} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:33:52.123668 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-52b6bae2-a981-4ae6-a451-dcb647203d53 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:52.131474 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-52b6bae2-a981-4ae6-a451-dcb647203d53 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:52.131989 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-52b6bae2-a981-4ae6-a451-dcb647203d53 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:52.132764 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-52b6bae2-a981-4ae6-a451-dcb647203d53 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:52.133204 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-52b6bae2-a981-4ae6-a451-dcb647203d53 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:52.814582 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-91f6f2e7-8929-4175-a253-dd071ddde8b7 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:52.816047 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-91f6f2e7-8929-4175-a253-dd071ddde8b7 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:52.830312 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-91f6f2e7-8929-4175-a253-dd071ddde8b7 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:52.831930 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-91f6f2e7-8929-4175-a253-dd071ddde8b7 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:52.833457 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-91f6f2e7-8929-4175-a253-dd071ddde8b7 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:52.834229 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-91f6f2e7-8929-4175-a253-dd071ddde8b7 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:53.106273 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-91f6f2e7-8929-4175-a253-dd071ddde8b7 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:53.114979 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-91f6f2e7-8929-4175-a253-dd071ddde8b7 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:53.118203 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-91f6f2e7-8929-4175-a253-dd071ddde8b7 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:53.119711 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-91f6f2e7-8929-4175-a253-dd071ddde8b7 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1808 microversion: 2.20 time: 0.312152 Jun 30 18:33:53.121020 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 328/662] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:33:52 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1808 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:33:53.608098 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-37fa5ad1-3e88-4a7f-ae27-216b004aecc6 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Action: 'create', calling method: .version_select at 0x7f1804c61c10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-274103547", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHspU796k3pELaXWF+DqKQJG6IirUpcNa/8JgOLarytiK/M42hMwID1e9Pf9v9OZch+Aetg5tZEktLmRulXhuLC/xM5zFn2cYrX7V2VCkWsxyzDl6nKi9iwWRNvpFRuDAA=="}} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:33:53.622875 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.quota [None req-37fa5ad1-3e88-4a7f-ae27-216b004aecc6 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Getting quotas for project 64655c9e82bb4515a976f41ac93b242f. Resources: {'key_pairs'} {{(pid=117940) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 18:33:53.627815 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.quota [None req-37fa5ad1-3e88-4a7f-ae27-216b004aecc6 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Getting quotas for user 31c0594d0be84154a601d625bca699cd and project 64655c9e82bb4515a976f41ac93b242f. Resources: {'key_pairs'} {{(pid=117940) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 18:33:53.650041 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-37fa5ad1-3e88-4a7f-ae27-216b004aecc6 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.218750 Jun 30 18:33:53.650729 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 329/663] 10.222.0.33 () {60 vars in 1158 bytes} [Thu Jun 30 18:33:53 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:33:54.139840 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-308f0a51-7fcb-4487-ba7f-d66dcb1f9704 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:54.140509 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-308f0a51-7fcb-4487-ba7f-d66dcb1f9704 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:54.147466 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-308f0a51-7fcb-4487-ba7f-d66dcb1f9704 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:54.148002 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-308f0a51-7fcb-4487-ba7f-d66dcb1f9704 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:54.148862 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-308f0a51-7fcb-4487-ba7f-d66dcb1f9704 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:54.149358 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-308f0a51-7fcb-4487-ba7f-d66dcb1f9704 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:54.318054 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-308f0a51-7fcb-4487-ba7f-d66dcb1f9704 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:54.327423 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-308f0a51-7fcb-4487-ba7f-d66dcb1f9704 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:54.328906 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-308f0a51-7fcb-4487-ba7f-d66dcb1f9704 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:54.330827 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-308f0a51-7fcb-4487-ba7f-d66dcb1f9704 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1808 microversion: 2.20 time: 0.194831 Jun 30 18:33:54.331381 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 330/664] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:33:54 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1808 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:33:55.350206 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-74cdd61c-f03c-4bc2-80f1-46d3894f4be1 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:55.350836 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-74cdd61c-f03c-4bc2-80f1-46d3894f4be1 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:55.357293 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-74cdd61c-f03c-4bc2-80f1-46d3894f4be1 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:55.357777 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-74cdd61c-f03c-4bc2-80f1-46d3894f4be1 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:55.358528 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-74cdd61c-f03c-4bc2-80f1-46d3894f4be1 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:55.358956 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-74cdd61c-f03c-4bc2-80f1-46d3894f4be1 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:55.500434 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-74cdd61c-f03c-4bc2-80f1-46d3894f4be1 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:55.510667 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-74cdd61c-f03c-4bc2-80f1-46d3894f4be1 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:55.512182 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-74cdd61c-f03c-4bc2-80f1-46d3894f4be1 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:55.513348 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-74cdd61c-f03c-4bc2-80f1-46d3894f4be1 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1808 microversion: 2.20 time: 0.167663 Jun 30 18:33:55.513937 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 331/665] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:33:55 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 18:33:56.448049 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-52b6bae2-a981-4ae6-a451-dcb647203d53 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "POST /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.332614 Jun 30 18:33:56.448682 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 335/666] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 30 18:33:52 2022] POST /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d/os-volume_attachments => generated 194 bytes in 4334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:33:56.532723 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-d8579287-b8fc-41ee-869b-7c0525189197 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:56.533324 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-d8579287-b8fc-41ee-869b-7c0525189197 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:56.539462 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d8579287-b8fc-41ee-869b-7c0525189197 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:56.540113 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d8579287-b8fc-41ee-869b-7c0525189197 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:56.541068 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d8579287-b8fc-41ee-869b-7c0525189197 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:56.541869 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d8579287-b8fc-41ee-869b-7c0525189197 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:56.715804 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-d8579287-b8fc-41ee-869b-7c0525189197 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:56.733009 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-d8579287-b8fc-41ee-869b-7c0525189197 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:56.743421 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-d8579287-b8fc-41ee-869b-7c0525189197 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:56.749154 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-d8579287-b8fc-41ee-869b-7c0525189197 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1808 microversion: 2.20 time: 0.220656 Jun 30 18:33:56.761811 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 332/667] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:33:56 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1808 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:33:57.771046 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-3ff11d25-0aea-48f1-9f23-ab8646e1335e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:57.771840 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-3ff11d25-0aea-48f1-9f23-ab8646e1335e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:57.775595 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_api:SELECT=28 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:33:57.780854 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3ff11d25-0aea-48f1-9f23-ab8646e1335e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:57.781292 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3ff11d25-0aea-48f1-9f23-ab8646e1335e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:57.782101 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3ff11d25-0aea-48f1-9f23-ab8646e1335e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:57.782527 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3ff11d25-0aea-48f1-9f23-ab8646e1335e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:57.923998 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-3ff11d25-0aea-48f1-9f23-ab8646e1335e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:57.933028 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-3ff11d25-0aea-48f1-9f23-ab8646e1335e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:57.934559 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-3ff11d25-0aea-48f1-9f23-ab8646e1335e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:57.935711 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-3ff11d25-0aea-48f1-9f23-ab8646e1335e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1808 microversion: 2.20 time: 0.170088 Jun 30 18:33:57.936270 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 336/668] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:33:57 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:33:58.954864 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-ab08e163-bdca-4dc1-9fe2-76891358d9a4 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:58.955492 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-ab08e163-bdca-4dc1-9fe2-76891358d9a4 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:58.962262 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ab08e163-bdca-4dc1-9fe2-76891358d9a4 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:58.962713 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ab08e163-bdca-4dc1-9fe2-76891358d9a4 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:58.963483 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ab08e163-bdca-4dc1-9fe2-76891358d9a4 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:58.963917 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ab08e163-bdca-4dc1-9fe2-76891358d9a4 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:59.102643 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-ab08e163-bdca-4dc1-9fe2-76891358d9a4 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:59.110916 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-ab08e163-bdca-4dc1-9fe2-76891358d9a4 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:59.113400 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-ab08e163-bdca-4dc1-9fe2-76891358d9a4 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:59.114776 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-ab08e163-bdca-4dc1-9fe2-76891358d9a4 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1808 microversion: 2.20 time: 0.164090 Jun 30 18:33:59.115444 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 333/669] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:33:58 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:34:00.133314 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-cabcb5e4-0701-429b-8501-d84d20f48f1a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:00.133973 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-cabcb5e4-0701-429b-8501-d84d20f48f1a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:00.140444 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-cabcb5e4-0701-429b-8501-d84d20f48f1a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:00.140886 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-cabcb5e4-0701-429b-8501-d84d20f48f1a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:00.141661 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-cabcb5e4-0701-429b-8501-d84d20f48f1a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:00.142092 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-cabcb5e4-0701-429b-8501-d84d20f48f1a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:00.280115 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-cabcb5e4-0701-429b-8501-d84d20f48f1a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:00.288429 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-cabcb5e4-0701-429b-8501-d84d20f48f1a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:00.289937 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-cabcb5e4-0701-429b-8501-d84d20f48f1a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:00.291808 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-cabcb5e4-0701-429b-8501-d84d20f48f1a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1808 microversion: 2.20 time: 0.162481 Jun 30 18:34:00.292512 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 337/670] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:34:00 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:34:01.311077 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-a734faf7-ff74-44af-a186-8f3a6859f77f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:01.311640 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-a734faf7-ff74-44af-a186-8f3a6859f77f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:01.318043 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a734faf7-ff74-44af-a186-8f3a6859f77f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:01.318493 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a734faf7-ff74-44af-a186-8f3a6859f77f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:01.319249 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a734faf7-ff74-44af-a186-8f3a6859f77f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:01.319682 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a734faf7-ff74-44af-a186-8f3a6859f77f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:01.451155 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-a734faf7-ff74-44af-a186-8f3a6859f77f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:01.459700 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-a734faf7-ff74-44af-a186-8f3a6859f77f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:01.461192 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-a734faf7-ff74-44af-a186-8f3a6859f77f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:01.462375 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-a734faf7-ff74-44af-a186-8f3a6859f77f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1808 microversion: 2.20 time: 0.156108 Jun 30 18:34:01.462938 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 334/671] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:34:01 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:34:02.481362 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-b48f43b2-f84e-4095-aa47-c579e77015b3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:02.481975 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-b48f43b2-f84e-4095-aa47-c579e77015b3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:02.488536 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b48f43b2-f84e-4095-aa47-c579e77015b3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:02.488983 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b48f43b2-f84e-4095-aa47-c579e77015b3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:02.489771 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b48f43b2-f84e-4095-aa47-c579e77015b3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:02.490204 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b48f43b2-f84e-4095-aa47-c579e77015b3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:02.632802 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-b48f43b2-f84e-4095-aa47-c579e77015b3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:02.641988 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-b48f43b2-f84e-4095-aa47-c579e77015b3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:02.643461 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-b48f43b2-f84e-4095-aa47-c579e77015b3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:02.644592 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-b48f43b2-f84e-4095-aa47-c579e77015b3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1808 microversion: 2.20 time: 0.167233 Jun 30 18:34:02.645127 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 338/672] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:34:02 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:34:03.662438 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-720e4ff4-cba2-4eb8-bfc4-0f7e9eeea2d8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:03.663042 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-720e4ff4-cba2-4eb8-bfc4-0f7e9eeea2d8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:03.665334 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell0:SELECT=4 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:34:03.671187 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-720e4ff4-cba2-4eb8-bfc4-0f7e9eeea2d8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:03.671687 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-720e4ff4-cba2-4eb8-bfc4-0f7e9eeea2d8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:03.672448 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-720e4ff4-cba2-4eb8-bfc4-0f7e9eeea2d8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:03.673087 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-720e4ff4-cba2-4eb8-bfc4-0f7e9eeea2d8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:03.812861 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-720e4ff4-cba2-4eb8-bfc4-0f7e9eeea2d8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:03.821228 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-720e4ff4-cba2-4eb8-bfc4-0f7e9eeea2d8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:03.822911 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-720e4ff4-cba2-4eb8-bfc4-0f7e9eeea2d8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:03.824092 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-720e4ff4-cba2-4eb8-bfc4-0f7e9eeea2d8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1808 microversion: 2.20 time: 0.165475 Jun 30 18:34:03.825288 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 335/673] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:34:03 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:34:04.845043 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-a9f3c237-f5e2-494d-98cd-a839e15185ce tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:04.846455 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-a9f3c237-f5e2-494d-98cd-a839e15185ce tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:04.853329 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a9f3c237-f5e2-494d-98cd-a839e15185ce tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:04.854745 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a9f3c237-f5e2-494d-98cd-a839e15185ce tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:04.856858 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a9f3c237-f5e2-494d-98cd-a839e15185ce tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:04.856858 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a9f3c237-f5e2-494d-98cd-a839e15185ce tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:05.008169 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-a9f3c237-f5e2-494d-98cd-a839e15185ce tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:05.017007 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-a9f3c237-f5e2-494d-98cd-a839e15185ce tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:05.018529 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-a9f3c237-f5e2-494d-98cd-a839e15185ce tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:05.019722 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-a9f3c237-f5e2-494d-98cd-a839e15185ce tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1808 microversion: 2.20 time: 0.179783 Jun 30 18:34:05.020278 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 339/674] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:34:04 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 18:34:05.030754 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-0156581b-f5a2-441b-bffb-89e5bc37ec14 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:34:05.037252 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0156581b-f5a2-441b-bffb-89e5bc37ec14 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:05.037732 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0156581b-f5a2-441b-bffb-89e5bc37ec14 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:05.101240 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-0156581b-f5a2-441b-bffb-89e5bc37ec14 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Going to try to stop instance {{(pid=117940) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 30 18:34:05.146505 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-0156581b-f5a2-441b-bffb-89e5bc37ec14 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "POST /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d/action" status: 202 len: 0 microversion: 2.1 time: 0.122117 Jun 30 18:34:05.147109 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 336/675] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 30 18:34:05 2022] POST /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 18:34:05.155308 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-67f09b1c-e753-46e6-8229-e527f70f918b tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:05.155919 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-67f09b1c-e753-46e6-8229-e527f70f918b tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:05.162154 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-67f09b1c-e753-46e6-8229-e527f70f918b tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:05.162599 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-67f09b1c-e753-46e6-8229-e527f70f918b tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:05.163354 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-67f09b1c-e753-46e6-8229-e527f70f918b tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:05.163785 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-67f09b1c-e753-46e6-8229-e527f70f918b tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:05.303340 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-67f09b1c-e753-46e6-8229-e527f70f918b tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:05.311399 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-67f09b1c-e753-46e6-8229-e527f70f918b tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1723 microversion: 2.1 time: 0.159933 Jun 30 18:34:05.312281 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 340/676] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:05 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:34:06.038999 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-7301c704-44be-431f-9164-80efdd6408ae tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:06.039703 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-7301c704-44be-431f-9164-80efdd6408ae tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:06.046773 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7301c704-44be-431f-9164-80efdd6408ae tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:06.047227 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7301c704-44be-431f-9164-80efdd6408ae tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:06.047993 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7301c704-44be-431f-9164-80efdd6408ae tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:06.048427 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7301c704-44be-431f-9164-80efdd6408ae tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:06.140373 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-90ddec47-e1bc-489c-8ada-1568621bf264 req-0785ba38-0adf-474c-a195-dff426428b95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85c4025a-1510-4b69-a54e-94c9864064b9", "name": "network-vif-plugged", "status": "completed", "tag": "82ef2cd7-f1a8-48a7-bd5b-c0babc56b244"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:34:06.150512 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-90ddec47-e1bc-489c-8ada-1568621bf264 req-0785ba38-0adf-474c-a195-dff426428b95 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:06.151014 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-90ddec47-e1bc-489c-8ada-1568621bf264 req-0785ba38-0adf-474c-a195-dff426428b95 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:06.163911 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.compute.server_external_events [req-90ddec47-e1bc-489c-8ada-1568621bf264 req-0785ba38-0adf-474c-a195-dff426428b95 service nova] Creating event network-vif-plugged:82ef2cd7-f1a8-48a7-bd5b-c0babc56b244 for instance 85c4025a-1510-4b69-a54e-94c9864064b9 on hv-cinder-80378 Jun 30 18:34:06.169062 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-90ddec47-e1bc-489c-8ada-1568621bf264 req-0785ba38-0adf-474c-a195-dff426428b95 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033015 Jun 30 18:34:06.170553 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 341/677] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:34:06.191532 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-7301c704-44be-431f-9164-80efdd6408ae tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:06.200249 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-7301c704-44be-431f-9164-80efdd6408ae tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:06.202162 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-7301c704-44be-431f-9164-80efdd6408ae tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:06.203510 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-7301c704-44be-431f-9164-80efdd6408ae tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1808 microversion: 2.20 time: 0.168936 Jun 30 18:34:06.204139 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 337/678] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:34:06 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:34:06.329769 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-6630c467-7e97-48e8-ad34-51a7d1278c42 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:06.330530 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-6630c467-7e97-48e8-ad34-51a7d1278c42 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:06.336729 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6630c467-7e97-48e8-ad34-51a7d1278c42 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:06.337162 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6630c467-7e97-48e8-ad34-51a7d1278c42 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:06.337930 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6630c467-7e97-48e8-ad34-51a7d1278c42 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:06.338356 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6630c467-7e97-48e8-ad34-51a7d1278c42 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:06.475561 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-6630c467-7e97-48e8-ad34-51a7d1278c42 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:06.483468 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-6630c467-7e97-48e8-ad34-51a7d1278c42 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1723 microversion: 2.1 time: 0.158213 Jun 30 18:34:06.484036 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 342/679] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:06 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:34:07.221959 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-10ed9c8b-ef93-4d6b-8910-dcf240e4480d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:07.222574 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-10ed9c8b-ef93-4d6b-8910-dcf240e4480d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:07.228970 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-10ed9c8b-ef93-4d6b-8910-dcf240e4480d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:07.229418 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-10ed9c8b-ef93-4d6b-8910-dcf240e4480d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:07.230243 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-10ed9c8b-ef93-4d6b-8910-dcf240e4480d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:07.231197 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-10ed9c8b-ef93-4d6b-8910-dcf240e4480d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:07.364377 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-10ed9c8b-ef93-4d6b-8910-dcf240e4480d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:07.373355 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-10ed9c8b-ef93-4d6b-8910-dcf240e4480d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:07.374887 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-10ed9c8b-ef93-4d6b-8910-dcf240e4480d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:07.376045 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-10ed9c8b-ef93-4d6b-8910-dcf240e4480d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1808 microversion: 2.20 time: 0.157979 Jun 30 18:34:07.376600 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 338/680] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:34:07 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:34:07.500757 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-2d9d3c34-6fe7-442e-b6fa-a4c8a0b6c27a tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:07.501358 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-2d9d3c34-6fe7-442e-b6fa-a4c8a0b6c27a tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:07.507829 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2d9d3c34-6fe7-442e-b6fa-a4c8a0b6c27a tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:07.508274 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2d9d3c34-6fe7-442e-b6fa-a4c8a0b6c27a tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:07.509028 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2d9d3c34-6fe7-442e-b6fa-a4c8a0b6c27a tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:07.509460 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2d9d3c34-6fe7-442e-b6fa-a4c8a0b6c27a tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:07.648146 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-2d9d3c34-6fe7-442e-b6fa-a4c8a0b6c27a tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:07.656256 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-2d9d3c34-6fe7-442e-b6fa-a4c8a0b6c27a tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1723 microversion: 2.1 time: 0.160052 Jun 30 18:34:07.656801 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 343/681] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:07 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:34:08.394569 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-7eab0ea6-75be-4e22-98a8-e1e843e5c3c4 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:08.395175 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-7eab0ea6-75be-4e22-98a8-e1e843e5c3c4 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:08.401559 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7eab0ea6-75be-4e22-98a8-e1e843e5c3c4 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:08.402029 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7eab0ea6-75be-4e22-98a8-e1e843e5c3c4 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:08.403890 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7eab0ea6-75be-4e22-98a8-e1e843e5c3c4 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:08.404329 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7eab0ea6-75be-4e22-98a8-e1e843e5c3c4 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:08.534834 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-7eab0ea6-75be-4e22-98a8-e1e843e5c3c4 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:08.544458 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-7eab0ea6-75be-4e22-98a8-e1e843e5c3c4 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:08.546038 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-7eab0ea6-75be-4e22-98a8-e1e843e5c3c4 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:08.547219 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-7eab0ea6-75be-4e22-98a8-e1e843e5c3c4 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1808 microversion: 2.20 time: 0.156594 Jun 30 18:34:08.547802 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 339/682] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:34:08 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:34:08.673301 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-3a7ccecb-1523-48ec-b442-c5e5b3ca5480 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:08.673854 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-3a7ccecb-1523-48ec-b442-c5e5b3ca5480 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:08.680268 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3a7ccecb-1523-48ec-b442-c5e5b3ca5480 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:08.680713 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3a7ccecb-1523-48ec-b442-c5e5b3ca5480 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:08.681468 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3a7ccecb-1523-48ec-b442-c5e5b3ca5480 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:08.681929 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3a7ccecb-1523-48ec-b442-c5e5b3ca5480 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:08.813858 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-3a7ccecb-1523-48ec-b442-c5e5b3ca5480 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:08.821607 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-3a7ccecb-1523-48ec-b442-c5e5b3ca5480 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1723 microversion: 2.1 time: 0.152221 Jun 30 18:34:08.822175 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 344/683] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:08 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:34:09.566383 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-5dd282d0-3ae0-4047-a854-41c05bc03df8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:09.567141 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-5dd282d0-3ae0-4047-a854-41c05bc03df8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:09.573892 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5dd282d0-3ae0-4047-a854-41c05bc03df8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:09.574411 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5dd282d0-3ae0-4047-a854-41c05bc03df8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:09.575234 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5dd282d0-3ae0-4047-a854-41c05bc03df8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:09.576621 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5dd282d0-3ae0-4047-a854-41c05bc03df8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:09.712251 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-5dd282d0-3ae0-4047-a854-41c05bc03df8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:09.714563 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:34:09.723301 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-5dd282d0-3ae0-4047-a854-41c05bc03df8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:09.724867 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-5dd282d0-3ae0-4047-a854-41c05bc03df8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:09.725987 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-5dd282d0-3ae0-4047-a854-41c05bc03df8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1808 microversion: 2.20 time: 0.164350 Jun 30 18:34:09.726536 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 340/684] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:34:09 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:34:09.839817 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-9991cafb-e366-4973-9b22-e5efbaeb090e tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:09.840416 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-9991cafb-e366-4973-9b22-e5efbaeb090e tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:09.846981 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9991cafb-e366-4973-9b22-e5efbaeb090e tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:09.847417 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9991cafb-e366-4973-9b22-e5efbaeb090e tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:09.848156 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9991cafb-e366-4973-9b22-e5efbaeb090e tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:09.848582 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9991cafb-e366-4973-9b22-e5efbaeb090e tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:09.992808 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-9991cafb-e366-4973-9b22-e5efbaeb090e tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:10.002618 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-9991cafb-e366-4973-9b22-e5efbaeb090e tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1723 microversion: 2.1 time: 0.166585 Jun 30 18:34:10.003187 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 345/685] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:09 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:34:10.744361 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-a8a8001e-d1d5-4339-95c0-a38e654f4abf tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:10.744979 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-a8a8001e-d1d5-4339-95c0-a38e654f4abf tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:10.748225 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:34:10.754610 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a8a8001e-d1d5-4339-95c0-a38e654f4abf tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:10.755051 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a8a8001e-d1d5-4339-95c0-a38e654f4abf tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:10.755808 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a8a8001e-d1d5-4339-95c0-a38e654f4abf tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:10.756233 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a8a8001e-d1d5-4339-95c0-a38e654f4abf tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:10.885566 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-a8a8001e-d1d5-4339-95c0-a38e654f4abf tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:10.894363 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-a8a8001e-d1d5-4339-95c0-a38e654f4abf tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:10.895836 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-a8a8001e-d1d5-4339-95c0-a38e654f4abf tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:10.896975 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-a8a8001e-d1d5-4339-95c0-a38e654f4abf tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1795 microversion: 2.20 time: 0.156619 Jun 30 18:34:10.897525 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 341/686] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:34:10 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1795 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:34:11.018688 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-1a59a2a4-63a0-40f8-bee6-0a5d7750bf40 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:11.019218 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-1a59a2a4-63a0-40f8-bee6-0a5d7750bf40 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:11.025784 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1a59a2a4-63a0-40f8-bee6-0a5d7750bf40 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:11.026219 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1a59a2a4-63a0-40f8-bee6-0a5d7750bf40 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:11.026960 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1a59a2a4-63a0-40f8-bee6-0a5d7750bf40 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:11.027888 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1a59a2a4-63a0-40f8-bee6-0a5d7750bf40 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:11.157134 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-1a59a2a4-63a0-40f8-bee6-0a5d7750bf40 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:11.164957 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-1a59a2a4-63a0-40f8-bee6-0a5d7750bf40 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1723 microversion: 2.1 time: 0.150103 Jun 30 18:34:11.165499 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 346/687] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:11 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:34:12.182998 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-1f98659b-fc4c-441e-8e9e-a0b8adb231b8 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:12.183601 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-1f98659b-fc4c-441e-8e9e-a0b8adb231b8 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:12.191207 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-1f98659b-fc4c-441e-8e9e-a0b8adb231b8 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:12.191653 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-1f98659b-fc4c-441e-8e9e-a0b8adb231b8 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:12.192402 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-1f98659b-fc4c-441e-8e9e-a0b8adb231b8 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:12.192832 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-1f98659b-fc4c-441e-8e9e-a0b8adb231b8 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:12.323185 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-1f98659b-fc4c-441e-8e9e-a0b8adb231b8 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:12.331710 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-1f98659b-fc4c-441e-8e9e-a0b8adb231b8 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1723 microversion: 2.1 time: 0.152581 Jun 30 18:34:12.332273 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 342/688] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:12 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:34:13.349698 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-3bd7fd07-07da-47bb-83cb-c05c62bb04a7 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:13.350233 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-3bd7fd07-07da-47bb-83cb-c05c62bb04a7 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:13.357229 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3bd7fd07-07da-47bb-83cb-c05c62bb04a7 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:13.357996 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3bd7fd07-07da-47bb-83cb-c05c62bb04a7 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:13.358764 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3bd7fd07-07da-47bb-83cb-c05c62bb04a7 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:13.359191 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3bd7fd07-07da-47bb-83cb-c05c62bb04a7 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:13.486681 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-3bd7fd07-07da-47bb-83cb-c05c62bb04a7 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:13.488922 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:34:13.495712 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-3bd7fd07-07da-47bb-83cb-c05c62bb04a7 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1723 microversion: 2.1 time: 0.149921 Jun 30 18:34:13.496267 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 347/689] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:13 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:34:14.513932 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-27f31634-5fa2-46e0-b913-2117392686e9 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:14.514542 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-27f31634-5fa2-46e0-b913-2117392686e9 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:14.521040 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-27f31634-5fa2-46e0-b913-2117392686e9 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:14.521561 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-27f31634-5fa2-46e0-b913-2117392686e9 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:14.522606 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-27f31634-5fa2-46e0-b913-2117392686e9 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:14.523158 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-27f31634-5fa2-46e0-b913-2117392686e9 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:14.660489 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-27f31634-5fa2-46e0-b913-2117392686e9 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:14.668325 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-27f31634-5fa2-46e0-b913-2117392686e9 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1723 microversion: 2.1 time: 0.158876 Jun 30 18:34:14.668880 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 343/690] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:14 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:34:15.686048 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-8030c311-d581-448c-9eaa-510795d3899f tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:15.686658 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-8030c311-d581-448c-9eaa-510795d3899f tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:15.694573 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8030c311-d581-448c-9eaa-510795d3899f tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:15.695009 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8030c311-d581-448c-9eaa-510795d3899f tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:15.695755 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8030c311-d581-448c-9eaa-510795d3899f tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:15.696179 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8030c311-d581-448c-9eaa-510795d3899f tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:15.828561 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-8030c311-d581-448c-9eaa-510795d3899f tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:15.836810 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-8030c311-d581-448c-9eaa-510795d3899f tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1723 microversion: 2.1 time: 0.154537 Jun 30 18:34:15.837509 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 348/691] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:15 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:34:16.854191 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-03e11147-9672-4d38-9011-d762b8a71a48 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:16.854816 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-03e11147-9672-4d38-9011-d762b8a71a48 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:16.861638 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-03e11147-9672-4d38-9011-d762b8a71a48 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:16.862087 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-03e11147-9672-4d38-9011-d762b8a71a48 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:16.862836 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-03e11147-9672-4d38-9011-d762b8a71a48 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:16.863266 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-03e11147-9672-4d38-9011-d762b8a71a48 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:16.992687 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-03e11147-9672-4d38-9011-d762b8a71a48 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:17.001005 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-03e11147-9672-4d38-9011-d762b8a71a48 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1700 microversion: 2.1 time: 0.150726 Jun 30 18:34:17.001558 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 344/692] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:16 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1700 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:34:17.017079 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-e59f1a79-8bd8-44fc-864c-a648764a55da tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:34:17.023680 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e59f1a79-8bd8-44fc-864c-a648764a55da tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:17.024154 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e59f1a79-8bd8-44fc-864c-a648764a55da tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:17.086060 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-e59f1a79-8bd8-44fc-864c-a648764a55da tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Going to try to start instance {{(pid=117941) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 30 18:34:17.133882 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-e59f1a79-8bd8-44fc-864c-a648764a55da tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "POST /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d/action" status: 202 len: 0 microversion: 2.1 time: 0.120502 Jun 30 18:34:17.134451 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 349/693] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 30 18:34:17 2022] POST /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 18:34:17.143193 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-7ca6342a-80f2-4fe3-9f4f-5144b6142560 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:17.143812 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-7ca6342a-80f2-4fe3-9f4f-5144b6142560 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:17.150481 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7ca6342a-80f2-4fe3-9f4f-5144b6142560 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:17.150933 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7ca6342a-80f2-4fe3-9f4f-5144b6142560 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:17.151726 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7ca6342a-80f2-4fe3-9f4f-5144b6142560 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:17.152303 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7ca6342a-80f2-4fe3-9f4f-5144b6142560 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:17.313659 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-7ca6342a-80f2-4fe3-9f4f-5144b6142560 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:17.321475 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-7ca6342a-80f2-4fe3-9f4f-5144b6142560 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1709 microversion: 2.1 time: 0.182859 Jun 30 18:34:17.322239 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 345/694] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:17 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1709 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:34:18.344161 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-84ad8914-6f5e-4430-b94b-aba652527ec6 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:18.344857 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-84ad8914-6f5e-4430-b94b-aba652527ec6 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:18.350853 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-84ad8914-6f5e-4430-b94b-aba652527ec6 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:18.351298 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-84ad8914-6f5e-4430-b94b-aba652527ec6 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:18.352174 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-84ad8914-6f5e-4430-b94b-aba652527ec6 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:18.352463 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-84ad8914-6f5e-4430-b94b-aba652527ec6 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:18.406674 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-0bff8d01-e4d0-43f1-af40-3f5f85330e84 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1559895323", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-274103547", "security_groups": [{"name": "tempest-secgroup-smoke-1376425930"}], "block_device_mapping_v2": [{"uuid": "d794a9b0-9e30-4bf8-b03e-ad4ad59d36d7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2fc6fe0c-6090-4d20-bc8a-e6954c35f796"}]}} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:34:18.502017 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-84ad8914-6f5e-4430-b94b-aba652527ec6 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:18.509836 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-84ad8914-6f5e-4430-b94b-aba652527ec6 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1709 microversion: 2.1 time: 0.171092 Jun 30 18:34:18.510408 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 350/695] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:18 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1709 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:34:18.534565 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.network.neutron [None req-0bff8d01-e4d0-43f1-af40-3f5f85330e84 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] validate_networks() for [('2fc6fe0c-6090-4d20-bc8a-e6954c35f796', None, None, None, None, None)] {{(pid=117940) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 18:34:18.902397 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-0bff8d01-e4d0-43f1-af40-3f5f85330e84 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Flavor limits 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 18:34:18.902814 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-0bff8d01-e4d0-43f1-af40-3f5f85330e84 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Image limits 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 18:34:18.903275 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-0bff8d01-e4d0-43f1-af40-3f5f85330e84 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Flavor pref 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 18:34:18.903751 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-0bff8d01-e4d0-43f1-af40-3f5f85330e84 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Image pref 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 18:34:18.904386 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-0bff8d01-e4d0-43f1-af40-3f5f85330e84 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 18:34:18.913089 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0bff8d01-e4d0-43f1-af40-3f5f85330e84 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:18.913526 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0bff8d01-e4d0-43f1-af40-3f5f85330e84 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:18.914335 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0bff8d01-e4d0-43f1-af40-3f5f85330e84 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:18.914755 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0bff8d01-e4d0-43f1-af40-3f5f85330e84 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:18.930557 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.quota [None req-0bff8d01-e4d0-43f1-af40-3f5f85330e84 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Getting quotas for project 64655c9e82bb4515a976f41ac93b242f. Resources: {'ram', 'instances', 'cores'} {{(pid=117940) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 18:34:18.934412 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.quota [None req-0bff8d01-e4d0-43f1-af40-3f5f85330e84 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Getting quotas for user 31c0594d0be84154a601d625bca699cd and project 64655c9e82bb4515a976f41ac93b242f. Resources: {'ram', 'instances', 'cores'} {{(pid=117940) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 18:34:18.992866 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-0bff8d01-e4d0-43f1-af40-3f5f85330e84 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Going to run 1 instances... {{(pid=117940) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 18:34:18.994975 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-0bff8d01-e4d0-43f1-af40-3f5f85330e84 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: 44d46d26-912d-40fd-8bd6-5b576e81cf20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d794a9b0-9e30-4bf8-b03e-ad4ad59d36d7',volume_size=None,volume_type=None)] {{(pid=117940) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 18:34:19.130198 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-0bff8d01-e4d0-43f1-af40-3f5f85330e84 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.727437 Jun 30 18:34:19.130832 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 346/696] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 30 18:34:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 30 18:34:19.142232 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-139bb635-3971-43cd-862f-eca0b4b151c5 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:19.142837 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-139bb635-3971-43cd-862f-eca0b4b151c5 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: 44d46d26-912d-40fd-8bd6-5b576e81cf20] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:19.201650 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-139bb635-3971-43cd-862f-eca0b4b151c5 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:19.208430 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-139bb635-3971-43cd-862f-eca0b4b151c5 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20" status: 200 len: 1094 microversion: 2.1 time: 0.071598 Jun 30 18:34:19.208990 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 351/697] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:19 2022] GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20 => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:34:19.528420 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-a712dacb-94b1-4fdd-b6d6-d49dc690f090 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:19.529160 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-a712dacb-94b1-4fdd-b6d6-d49dc690f090 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:19.536379 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a712dacb-94b1-4fdd-b6d6-d49dc690f090 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:19.536836 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a712dacb-94b1-4fdd-b6d6-d49dc690f090 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:19.537600 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a712dacb-94b1-4fdd-b6d6-d49dc690f090 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:19.538061 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a712dacb-94b1-4fdd-b6d6-d49dc690f090 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:19.673466 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-a712dacb-94b1-4fdd-b6d6-d49dc690f090 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:19.681419 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-a712dacb-94b1-4fdd-b6d6-d49dc690f090 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1713 microversion: 2.1 time: 0.157422 Jun 30 18:34:19.681999 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 347/698] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:19 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1713 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:34:20.225744 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-7d0236f2-29b0-45be-b389-6521e640dcf2 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:20.226350 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-7d0236f2-29b0-45be-b389-6521e640dcf2 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: 44d46d26-912d-40fd-8bd6-5b576e81cf20] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:20.232860 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7d0236f2-29b0-45be-b389-6521e640dcf2 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:20.233309 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7d0236f2-29b0-45be-b389-6521e640dcf2 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:20.234092 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7d0236f2-29b0-45be-b389-6521e640dcf2 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:20.234702 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7d0236f2-29b0-45be-b389-6521e640dcf2 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:20.536261 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-7d0236f2-29b0-45be-b389-6521e640dcf2 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:20.545207 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-7d0236f2-29b0-45be-b389-6521e640dcf2 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20" status: 200 len: 1210 microversion: 2.1 time: 0.322428 Jun 30 18:34:20.546382 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 352/699] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:20 2022] GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20 => generated 1210 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:34:21.562461 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-c4cb4af6-3396-4dc5-bb3f-456d5cb0e839 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:21.563749 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-c4cb4af6-3396-4dc5-bb3f-456d5cb0e839 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: 44d46d26-912d-40fd-8bd6-5b576e81cf20] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:21.570897 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c4cb4af6-3396-4dc5-bb3f-456d5cb0e839 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:21.571437 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c4cb4af6-3396-4dc5-bb3f-456d5cb0e839 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:21.572278 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c4cb4af6-3396-4dc5-bb3f-456d5cb0e839 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:21.572715 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c4cb4af6-3396-4dc5-bb3f-456d5cb0e839 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:21.764070 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-c4cb4af6-3396-4dc5-bb3f-456d5cb0e839 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:21.771711 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-c4cb4af6-3396-4dc5-bb3f-456d5cb0e839 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20" status: 200 len: 1266 microversion: 2.1 time: 0.213390 Jun 30 18:34:21.772487 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 348/700] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:21 2022] GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20 => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:34:21.962567 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-396ca998-2638-4b51-af36-5511811b0da8 req-cf201b78-8367-4254-8ba7-d4233b253452 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44d46d26-912d-40fd-8bd6-5b576e81cf20", "tag": "b367cc3f-9558-497f-9518-dc0d8b592a5c"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:34:21.971036 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-396ca998-2638-4b51-af36-5511811b0da8 req-cf201b78-8367-4254-8ba7-d4233b253452 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:21.971716 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-396ca998-2638-4b51-af36-5511811b0da8 req-cf201b78-8367-4254-8ba7-d4233b253452 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:21.983621 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.compute.server_external_events [req-396ca998-2638-4b51-af36-5511811b0da8 req-cf201b78-8367-4254-8ba7-d4233b253452 service nova] Creating event network-changed:b367cc3f-9558-497f-9518-dc0d8b592a5c for instance 44d46d26-912d-40fd-8bd6-5b576e81cf20 on hv-cinder-80378 Jun 30 18:34:21.989035 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-396ca998-2638-4b51-af36-5511811b0da8 req-cf201b78-8367-4254-8ba7-d4233b253452 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096292 Jun 30 18:34:21.989666 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 353/701] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:34:22.789678 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-3ac5ae31-a0e8-43b4-b906-c5efce493dd2 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:22.790288 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-3ac5ae31-a0e8-43b4-b906-c5efce493dd2 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: 44d46d26-912d-40fd-8bd6-5b576e81cf20] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:22.796986 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3ac5ae31-a0e8-43b4-b906-c5efce493dd2 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:22.797427 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3ac5ae31-a0e8-43b4-b906-c5efce493dd2 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:22.798207 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3ac5ae31-a0e8-43b4-b906-c5efce493dd2 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:22.798640 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3ac5ae31-a0e8-43b4-b906-c5efce493dd2 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:22.927960 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-3ac5ae31-a0e8-43b4-b906-c5efce493dd2 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:22.936406 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-3ac5ae31-a0e8-43b4-b906-c5efce493dd2 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20" status: 200 len: 1266 microversion: 2.1 time: 0.149521 Jun 30 18:34:22.936976 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 349/702] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:22 2022] GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:34:23.955299 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-a692eec8-541b-4879-9bc7-930cc2f7e585 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:23.956134 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-a692eec8-541b-4879-9bc7-930cc2f7e585 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: 44d46d26-912d-40fd-8bd6-5b576e81cf20] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:23.962338 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a692eec8-541b-4879-9bc7-930cc2f7e585 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:23.962785 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a692eec8-541b-4879-9bc7-930cc2f7e585 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:23.963543 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a692eec8-541b-4879-9bc7-930cc2f7e585 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:23.963987 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a692eec8-541b-4879-9bc7-930cc2f7e585 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:24.131372 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-a692eec8-541b-4879-9bc7-930cc2f7e585 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:24.139484 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-a692eec8-541b-4879-9bc7-930cc2f7e585 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20" status: 200 len: 1266 microversion: 2.1 time: 0.190017 Jun 30 18:34:24.140053 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 354/703] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:23 2022] GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20 => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:34:25.157129 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-66eac0f1-2cd8-4086-ba11-1e031c488f2a tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:25.157680 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-66eac0f1-2cd8-4086-ba11-1e031c488f2a tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: 44d46d26-912d-40fd-8bd6-5b576e81cf20] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:25.164186 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-66eac0f1-2cd8-4086-ba11-1e031c488f2a tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:25.164636 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-66eac0f1-2cd8-4086-ba11-1e031c488f2a tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:25.165393 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-66eac0f1-2cd8-4086-ba11-1e031c488f2a tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:25.165854 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-66eac0f1-2cd8-4086-ba11-1e031c488f2a tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:25.294033 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-66eac0f1-2cd8-4086-ba11-1e031c488f2a tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:25.301824 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-66eac0f1-2cd8-4086-ba11-1e031c488f2a tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20" status: 200 len: 1266 microversion: 2.1 time: 0.149067 Jun 30 18:34:25.302387 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 350/704] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:25 2022] GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:34:26.319237 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-4924884d-72c0-4278-98ce-880cd08624fd tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:26.319781 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-4924884d-72c0-4278-98ce-880cd08624fd tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: 44d46d26-912d-40fd-8bd6-5b576e81cf20] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:26.327151 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-4924884d-72c0-4278-98ce-880cd08624fd tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:26.327592 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-4924884d-72c0-4278-98ce-880cd08624fd tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:26.328601 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-4924884d-72c0-4278-98ce-880cd08624fd tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:26.329034 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-4924884d-72c0-4278-98ce-880cd08624fd tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:26.461614 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-4924884d-72c0-4278-98ce-880cd08624fd tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:26.470073 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-4924884d-72c0-4278-98ce-880cd08624fd tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20" status: 200 len: 1266 microversion: 2.1 time: 0.154723 Jun 30 18:34:26.470637 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 355/705] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:26 2022] GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:34:26.483454 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-1d76a05c-5fbf-41c6-af01-94fdcef2ba21 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8253391e-4660-4a7d-8011-7f5919c6a661"}} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:34:26.484614 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-1d76a05c-5fbf-41c6-af01-94fdcef2ba21 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:26.490558 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-1d76a05c-5fbf-41c6-af01-94fdcef2ba21 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:26.491004 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-1d76a05c-5fbf-41c6-af01-94fdcef2ba21 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:26.491758 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-1d76a05c-5fbf-41c6-af01-94fdcef2ba21 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:26.492189 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-1d76a05c-5fbf-41c6-af01-94fdcef2ba21 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:26.752525 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-1d76a05c-5fbf-41c6-af01-94fdcef2ba21 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "POST /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.372868 Jun 30 18:34:26.753122 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 351/706] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 30 18:34:26 2022] POST /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90/os-volume_attachments => generated 194 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:34:27.486828 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-023a4134-bd95-4c70-8d69-908a836b742c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:27.487448 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-023a4134-bd95-4c70-8d69-908a836b742c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: 44d46d26-912d-40fd-8bd6-5b576e81cf20] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:27.495871 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-023a4134-bd95-4c70-8d69-908a836b742c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:27.495871 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-023a4134-bd95-4c70-8d69-908a836b742c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:27.495871 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-023a4134-bd95-4c70-8d69-908a836b742c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:27.495871 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-023a4134-bd95-4c70-8d69-908a836b742c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:27.644963 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-023a4134-bd95-4c70-8d69-908a836b742c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:27.652717 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-023a4134-bd95-4c70-8d69-908a836b742c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20" status: 200 len: 1266 microversion: 2.1 time: 0.169886 Jun 30 18:34:27.653288 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 356/707] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:27 2022] GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:34:28.672375 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-5e9f9fe0-e78f-46c6-84cd-c682c50e6500 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:28.673064 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-5e9f9fe0-e78f-46c6-84cd-c682c50e6500 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: 44d46d26-912d-40fd-8bd6-5b576e81cf20] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:28.679235 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5e9f9fe0-e78f-46c6-84cd-c682c50e6500 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:28.679681 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5e9f9fe0-e78f-46c6-84cd-c682c50e6500 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:28.680439 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5e9f9fe0-e78f-46c6-84cd-c682c50e6500 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:28.680874 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5e9f9fe0-e78f-46c6-84cd-c682c50e6500 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:28.810779 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-5e9f9fe0-e78f-46c6-84cd-c682c50e6500 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:28.818957 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-5e9f9fe0-e78f-46c6-84cd-c682c50e6500 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20" status: 200 len: 1266 microversion: 2.1 time: 0.151864 Jun 30 18:34:28.819513 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 352/708] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:28 2022] GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:34:29.836097 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-5c0705c8-ffcd-4790-b782-55b9276afe88 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:29.836690 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-5c0705c8-ffcd-4790-b782-55b9276afe88 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: 44d46d26-912d-40fd-8bd6-5b576e81cf20] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:29.839082 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell0:SELECT=2 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:34:29.839727 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_api:SELECT=44 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:34:29.846232 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-5c0705c8-ffcd-4790-b782-55b9276afe88 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:29.846675 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-5c0705c8-ffcd-4790-b782-55b9276afe88 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:29.847412 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-5c0705c8-ffcd-4790-b782-55b9276afe88 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:29.847835 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-5c0705c8-ffcd-4790-b782-55b9276afe88 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:29.980844 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-5c0705c8-ffcd-4790-b782-55b9276afe88 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:29.988246 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-5c0705c8-ffcd-4790-b782-55b9276afe88 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20" status: 200 len: 1266 microversion: 2.1 time: 0.155921 Jun 30 18:34:29.988810 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 357/709] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:29 2022] GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:34:31.005213 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-ff3262ed-0cc4-4371-9eb9-f9ac2b86cea5 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:31.006221 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-ff3262ed-0cc4-4371-9eb9-f9ac2b86cea5 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: 44d46d26-912d-40fd-8bd6-5b576e81cf20] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:31.012857 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell0:SELECT=2 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:34:31.013608 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell0:SELECT=6 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:34:31.017460 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ff3262ed-0cc4-4371-9eb9-f9ac2b86cea5 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:31.017952 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ff3262ed-0cc4-4371-9eb9-f9ac2b86cea5 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:31.018717 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ff3262ed-0cc4-4371-9eb9-f9ac2b86cea5 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:31.019282 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ff3262ed-0cc4-4371-9eb9-f9ac2b86cea5 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:31.156158 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-ff3262ed-0cc4-4371-9eb9-f9ac2b86cea5 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:31.163550 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-ff3262ed-0cc4-4371-9eb9-f9ac2b86cea5 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20" status: 200 len: 1266 microversion: 2.1 time: 0.163059 Jun 30 18:34:31.164113 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 353/710] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:30 2022] GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:34:32.180167 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-48a2cb06-3f98-4db7-b50a-35079f7e2288 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:32.180970 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-48a2cb06-3f98-4db7-b50a-35079f7e2288 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: 44d46d26-912d-40fd-8bd6-5b576e81cf20] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:32.188044 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-48a2cb06-3f98-4db7-b50a-35079f7e2288 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:32.188478 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-48a2cb06-3f98-4db7-b50a-35079f7e2288 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:32.189229 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-48a2cb06-3f98-4db7-b50a-35079f7e2288 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:32.189674 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-48a2cb06-3f98-4db7-b50a-35079f7e2288 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:32.324642 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-48a2cb06-3f98-4db7-b50a-35079f7e2288 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:32.332798 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-48a2cb06-3f98-4db7-b50a-35079f7e2288 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20" status: 200 len: 1266 microversion: 2.1 time: 0.156404 Jun 30 18:34:32.333366 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 358/711] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:32 2022] GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:34:33.351796 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-a70ec3bc-635a-4c87-999b-a6e2ec27892c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:33.352332 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-a70ec3bc-635a-4c87-999b-a6e2ec27892c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: 44d46d26-912d-40fd-8bd6-5b576e81cf20] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:33.359522 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a70ec3bc-635a-4c87-999b-a6e2ec27892c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:33.359981 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a70ec3bc-635a-4c87-999b-a6e2ec27892c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:33.360732 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a70ec3bc-635a-4c87-999b-a6e2ec27892c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:33.361158 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a70ec3bc-635a-4c87-999b-a6e2ec27892c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:33.497245 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-a70ec3bc-635a-4c87-999b-a6e2ec27892c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:33.505210 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-a70ec3bc-635a-4c87-999b-a6e2ec27892c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20" status: 200 len: 1266 microversion: 2.1 time: 0.157566 Jun 30 18:34:33.505803 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 354/712] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:33 2022] GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:34:34.248265 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-4d0b3e32-1891-4d2f-9f6b-40959b812e5f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:34:34.249445 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-4d0b3e32-1891-4d2f-9f6b-40959b812e5f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:34.255687 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-4d0b3e32-1891-4d2f-9f6b-40959b812e5f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:34.256181 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-4d0b3e32-1891-4d2f-9f6b-40959b812e5f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:34.256949 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-4d0b3e32-1891-4d2f-9f6b-40959b812e5f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:34.257389 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-4d0b3e32-1891-4d2f-9f6b-40959b812e5f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:34.282310 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.objects.instance [None req-4d0b3e32-1891-4d2f-9f6b-40959b812e5f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lazy-loading 'flavor' on Instance uuid 0048b27f-0b3b-4654-8cf4-27f780ce5e90 {{(pid=117941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 18:34:34.355470 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [req-e17854ea-e7c2-4ddf-bfb7-9ca7822c3bea req-8bd49864-28ba-45c9-8c39-123f747204fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44d46d26-912d-40fd-8bd6-5b576e81cf20", "name": "network-vif-plugged", "status": "completed", "tag": "b367cc3f-9558-497f-9518-dc0d8b592a5c"}]} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:34:34.366746 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-e17854ea-e7c2-4ddf-bfb7-9ca7822c3bea req-8bd49864-28ba-45c9-8c39-123f747204fe service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:34.367363 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-e17854ea-e7c2-4ddf-bfb7-9ca7822c3bea req-8bd49864-28ba-45c9-8c39-123f747204fe service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:34.380170 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.compute.server_external_events [req-e17854ea-e7c2-4ddf-bfb7-9ca7822c3bea req-8bd49864-28ba-45c9-8c39-123f747204fe service nova] Creating event network-vif-plugged:b367cc3f-9558-497f-9518-dc0d8b592a5c for instance 44d46d26-912d-40fd-8bd6-5b576e81cf20 on hv-cinder-80378 Jun 30 18:34:34.385794 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [req-e17854ea-e7c2-4ddf-bfb7-9ca7822c3bea req-8bd49864-28ba-45c9-8c39-123f747204fe service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106580 Jun 30 18:34:34.386509 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 355/713] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:34:34.418503 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-4d0b3e32-1891-4d2f-9f6b-40959b812e5f tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "POST /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90/action" status: 200 len: 32 microversion: 2.1 time: 0.174468 Jun 30 18:34:34.419135 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 359/714] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 30 18:34:34 2022] POST /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90/action => generated 32 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 18:34:34.428867 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-4ed4b66b-cf61-433c-b964-09935bf14db2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:34.429567 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-4ed4b66b-cf61-433c-b964-09935bf14db2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:34.435799 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-4ed4b66b-cf61-433c-b964-09935bf14db2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:34.436248 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-4ed4b66b-cf61-433c-b964-09935bf14db2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:34.437008 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-4ed4b66b-cf61-433c-b964-09935bf14db2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:34.437446 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-4ed4b66b-cf61-433c-b964-09935bf14db2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:34.523173 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-77fa7e4b-b35b-4edc-8f27-3a4d8cbe4f5a tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:34.523988 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-77fa7e4b-b35b-4edc-8f27-3a4d8cbe4f5a tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: 44d46d26-912d-40fd-8bd6-5b576e81cf20] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:34.531359 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-77fa7e4b-b35b-4edc-8f27-3a4d8cbe4f5a tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:34.532053 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-77fa7e4b-b35b-4edc-8f27-3a4d8cbe4f5a tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:34.533057 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-77fa7e4b-b35b-4edc-8f27-3a4d8cbe4f5a tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:34.533430 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-77fa7e4b-b35b-4edc-8f27-3a4d8cbe4f5a tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:34.717799 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-4ed4b66b-cf61-433c-b964-09935bf14db2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:34.727442 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-4ed4b66b-cf61-433c-b964-09935bf14db2 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1734 microversion: 2.1 time: 0.302556 Jun 30 18:34:34.738298 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 356/715] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:34 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1734 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:34:34.760980 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-77fa7e4b-b35b-4edc-8f27-3a4d8cbe4f5a tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:34.770025 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-77fa7e4b-b35b-4edc-8f27-3a4d8cbe4f5a tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20" status: 200 len: 1266 microversion: 2.1 time: 0.250628 Jun 30 18:34:34.771195 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 360/716] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:34 2022] GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20 => generated 1266 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:34:35.745455 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-068eb653-65da-4c51-98c2-ba2613fb1b85 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:35.746106 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-068eb653-65da-4c51-98c2-ba2613fb1b85 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:35.752915 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-068eb653-65da-4c51-98c2-ba2613fb1b85 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:35.753362 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-068eb653-65da-4c51-98c2-ba2613fb1b85 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:35.754152 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-068eb653-65da-4c51-98c2-ba2613fb1b85 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:35.754586 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-068eb653-65da-4c51-98c2-ba2613fb1b85 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:35.769452 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:34:35.787066 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-7d208a31-4a4a-424a-a81d-9bf0ea564ef0 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:35.787670 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-7d208a31-4a4a-424a-a81d-9bf0ea564ef0 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: 44d46d26-912d-40fd-8bd6-5b576e81cf20] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:35.794113 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7d208a31-4a4a-424a-a81d-9bf0ea564ef0 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:35.794559 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7d208a31-4a4a-424a-a81d-9bf0ea564ef0 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:35.795970 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7d208a31-4a4a-424a-a81d-9bf0ea564ef0 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:35.796404 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7d208a31-4a4a-424a-a81d-9bf0ea564ef0 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:35.940546 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-068eb653-65da-4c51-98c2-ba2613fb1b85 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:35.948866 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-068eb653-65da-4c51-98c2-ba2613fb1b85 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1734 microversion: 2.1 time: 0.207323 Jun 30 18:34:35.949448 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 357/717] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:35 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1734 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:34:35.971297 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-7d208a31-4a4a-424a-a81d-9bf0ea564ef0 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:35.979112 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-7d208a31-4a4a-424a-a81d-9bf0ea564ef0 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20" status: 200 len: 1266 microversion: 2.1 time: 0.195723 Jun 30 18:34:35.979697 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 361/718] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:35 2022] GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20 => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:34:36.967086 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-54f6d097-4e2b-4cf4-bce4-d14b79501cdc tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:36.968375 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-54f6d097-4e2b-4cf4-bce4-d14b79501cdc tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:36.975210 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-54f6d097-4e2b-4cf4-bce4-d14b79501cdc tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:36.975661 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-54f6d097-4e2b-4cf4-bce4-d14b79501cdc tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:36.976440 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-54f6d097-4e2b-4cf4-bce4-d14b79501cdc tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:36.976875 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-54f6d097-4e2b-4cf4-bce4-d14b79501cdc tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:36.998748 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-c568b3f4-cb17-46cc-a3dd-2348e8195e29 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:36.999434 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-c568b3f4-cb17-46cc-a3dd-2348e8195e29 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: 44d46d26-912d-40fd-8bd6-5b576e81cf20] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:37.005753 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c568b3f4-cb17-46cc-a3dd-2348e8195e29 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:37.006207 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c568b3f4-cb17-46cc-a3dd-2348e8195e29 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:37.006973 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c568b3f4-cb17-46cc-a3dd-2348e8195e29 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:37.007586 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c568b3f4-cb17-46cc-a3dd-2348e8195e29 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:37.187642 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-54f6d097-4e2b-4cf4-bce4-d14b79501cdc tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:37.191972 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-c568b3f4-cb17-46cc-a3dd-2348e8195e29 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:37.195719 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-54f6d097-4e2b-4cf4-bce4-d14b79501cdc tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1734 microversion: 2.1 time: 0.232534 Jun 30 18:34:37.196297 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 358/719] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:36 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1734 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:34:37.199283 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-c568b3f4-cb17-46cc-a3dd-2348e8195e29 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20" status: 200 len: 1452 microversion: 2.1 time: 0.204889 Jun 30 18:34:37.199835 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 362/720] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:36 2022] GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20 => generated 1452 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:34:37.215664 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-a568c17b-9117-41c8-9840-1066d216f6a1 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:37.216379 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-a568c17b-9117-41c8-9840-1066d216f6a1 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: 44d46d26-912d-40fd-8bd6-5b576e81cf20] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:37.223452 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a568c17b-9117-41c8-9840-1066d216f6a1 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:37.223899 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a568c17b-9117-41c8-9840-1066d216f6a1 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:37.224659 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a568c17b-9117-41c8-9840-1066d216f6a1 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:37.225090 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a568c17b-9117-41c8-9840-1066d216f6a1 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:37.370610 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-a568c17b-9117-41c8-9840-1066d216f6a1 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:37.380572 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-a568c17b-9117-41c8-9840-1066d216f6a1 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20" status: 200 len: 1452 microversion: 2.1 time: 0.168726 Jun 30 18:34:37.381266 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 359/721] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:37 2022] GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20 => generated 1452 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:34:38.213982 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-321ac3bb-ee2e-436c-8b76-ed202286192c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:38.214590 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-321ac3bb-ee2e-436c-8b76-ed202286192c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:38.221916 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-321ac3bb-ee2e-436c-8b76-ed202286192c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:38.222361 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-321ac3bb-ee2e-436c-8b76-ed202286192c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:38.223152 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-321ac3bb-ee2e-436c-8b76-ed202286192c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:38.223585 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-321ac3bb-ee2e-436c-8b76-ed202286192c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:38.227663 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:34:38.359355 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-321ac3bb-ee2e-436c-8b76-ed202286192c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:38.367481 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-321ac3bb-ee2e-436c-8b76-ed202286192c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1734 microversion: 2.1 time: 0.157403 Jun 30 18:34:38.368042 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 363/722] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:38 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:34:39.107351 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [req-96e1a944-b263-40c6-9aee-9bcadf88bef7 req-fcb4b162-c321-4988-8c5c-ad0202048b66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44d46d26-912d-40fd-8bd6-5b576e81cf20", "tag": "b367cc3f-9558-497f-9518-dc0d8b592a5c"}]} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:34:39.115784 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-96e1a944-b263-40c6-9aee-9bcadf88bef7 req-fcb4b162-c321-4988-8c5c-ad0202048b66 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:39.116229 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-96e1a944-b263-40c6-9aee-9bcadf88bef7 req-fcb4b162-c321-4988-8c5c-ad0202048b66 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:39.128039 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.compute.server_external_events [req-96e1a944-b263-40c6-9aee-9bcadf88bef7 req-fcb4b162-c321-4988-8c5c-ad0202048b66 service nova] Creating event network-changed:b367cc3f-9558-497f-9518-dc0d8b592a5c for instance 44d46d26-912d-40fd-8bd6-5b576e81cf20 on hv-cinder-80378 Jun 30 18:34:39.133192 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [req-96e1a944-b263-40c6-9aee-9bcadf88bef7 req-fcb4b162-c321-4988-8c5c-ad0202048b66 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087651 Jun 30 18:34:39.133845 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 360/723] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:34:39.384255 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-9cf955d3-31ab-4a08-afda-d831b8afa436 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:39.385490 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-9cf955d3-31ab-4a08-afda-d831b8afa436 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:39.393197 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9cf955d3-31ab-4a08-afda-d831b8afa436 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:39.393670 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9cf955d3-31ab-4a08-afda-d831b8afa436 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:39.394425 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9cf955d3-31ab-4a08-afda-d831b8afa436 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:39.394853 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9cf955d3-31ab-4a08-afda-d831b8afa436 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:39.531375 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-9cf955d3-31ab-4a08-afda-d831b8afa436 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:39.539458 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-9cf955d3-31ab-4a08-afda-d831b8afa436 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1734 microversion: 2.1 time: 0.159045 Jun 30 18:34:39.540177 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 364/724] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:39 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:34:40.557852 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-fc2817ff-3cad-4154-ba0c-6600f8354696 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:40.558546 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-fc2817ff-3cad-4154-ba0c-6600f8354696 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:40.565380 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fc2817ff-3cad-4154-ba0c-6600f8354696 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:40.565863 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fc2817ff-3cad-4154-ba0c-6600f8354696 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:40.566619 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fc2817ff-3cad-4154-ba0c-6600f8354696 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:40.567054 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fc2817ff-3cad-4154-ba0c-6600f8354696 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:40.697482 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-fc2817ff-3cad-4154-ba0c-6600f8354696 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:40.705861 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-fc2817ff-3cad-4154-ba0c-6600f8354696 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1734 microversion: 2.1 time: 0.152169 Jun 30 18:34:40.706435 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 361/725] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:40 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:34:41.722729 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-e6261723-c8ce-4a94-8078-df96e351b488 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:41.723325 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-e6261723-c8ce-4a94-8078-df96e351b488 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:41.729772 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e6261723-c8ce-4a94-8078-df96e351b488 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:41.730213 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e6261723-c8ce-4a94-8078-df96e351b488 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:41.730952 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e6261723-c8ce-4a94-8078-df96e351b488 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:41.731374 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e6261723-c8ce-4a94-8078-df96e351b488 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:41.857893 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-e6261723-c8ce-4a94-8078-df96e351b488 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:41.866164 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-e6261723-c8ce-4a94-8078-df96e351b488 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1734 microversion: 2.1 time: 0.147269 Jun 30 18:34:41.866728 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 365/726] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:41 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:34:42.883083 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-4a2ab899-0681-4531-88c4-4f65d54d2fa3 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:42.883694 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-4a2ab899-0681-4531-88c4-4f65d54d2fa3 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:42.886221 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:34:42.892548 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-4a2ab899-0681-4531-88c4-4f65d54d2fa3 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:42.893007 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-4a2ab899-0681-4531-88c4-4f65d54d2fa3 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:42.893800 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-4a2ab899-0681-4531-88c4-4f65d54d2fa3 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:42.894239 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-4a2ab899-0681-4531-88c4-4f65d54d2fa3 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:43.029974 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-4a2ab899-0681-4531-88c4-4f65d54d2fa3 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:43.037954 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-4a2ab899-0681-4531-88c4-4f65d54d2fa3 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1734 microversion: 2.1 time: 0.158670 Jun 30 18:34:43.038503 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 362/727] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:42 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:34:44.054864 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-b04dc114-622a-4795-8b3c-1e365a465e88 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:44.055527 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-b04dc114-622a-4795-8b3c-1e365a465e88 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:44.062642 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b04dc114-622a-4795-8b3c-1e365a465e88 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:44.063081 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b04dc114-622a-4795-8b3c-1e365a465e88 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:44.063837 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b04dc114-622a-4795-8b3c-1e365a465e88 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:44.064274 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b04dc114-622a-4795-8b3c-1e365a465e88 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:44.191730 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-b04dc114-622a-4795-8b3c-1e365a465e88 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:44.199474 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-b04dc114-622a-4795-8b3c-1e365a465e88 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1734 microversion: 2.1 time: 0.148436 Jun 30 18:34:44.200044 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 366/728] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:44 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:34:45.216613 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-631eb920-851b-4969-bd67-6fee7671eefc tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:45.217228 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-631eb920-851b-4969-bd67-6fee7671eefc tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:45.223860 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-631eb920-851b-4969-bd67-6fee7671eefc tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:45.224304 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-631eb920-851b-4969-bd67-6fee7671eefc tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:45.225063 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-631eb920-851b-4969-bd67-6fee7671eefc tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:45.225496 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-631eb920-851b-4969-bd67-6fee7671eefc tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:45.354431 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-631eb920-851b-4969-bd67-6fee7671eefc tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:45.363477 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-631eb920-851b-4969-bd67-6fee7671eefc tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1734 microversion: 2.1 time: 0.150815 Jun 30 18:34:45.364050 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 363/729] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:45 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:34:46.380364 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-77942bd3-ad7e-4714-80c7-4ffaf9c6b3fa tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:46.380873 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-77942bd3-ad7e-4714-80c7-4ffaf9c6b3fa tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:46.387337 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-77942bd3-ad7e-4714-80c7-4ffaf9c6b3fa tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:46.387767 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-77942bd3-ad7e-4714-80c7-4ffaf9c6b3fa tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:46.388512 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-77942bd3-ad7e-4714-80c7-4ffaf9c6b3fa tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:46.388932 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-77942bd3-ad7e-4714-80c7-4ffaf9c6b3fa tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:46.520304 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-77942bd3-ad7e-4714-80c7-4ffaf9c6b3fa tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:46.528941 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-77942bd3-ad7e-4714-80c7-4ffaf9c6b3fa tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1734 microversion: 2.1 time: 0.152456 Jun 30 18:34:46.529502 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 367/730] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:46 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:34:47.546790 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-e5da2358-6b34-478a-87a6-0e991380cacd tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:47.547407 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-e5da2358-6b34-478a-87a6-0e991380cacd tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:47.553445 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e5da2358-6b34-478a-87a6-0e991380cacd tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:47.553914 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e5da2358-6b34-478a-87a6-0e991380cacd tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:47.554674 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e5da2358-6b34-478a-87a6-0e991380cacd tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:47.555101 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e5da2358-6b34-478a-87a6-0e991380cacd tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:47.683708 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-e5da2358-6b34-478a-87a6-0e991380cacd tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:47.692373 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-e5da2358-6b34-478a-87a6-0e991380cacd tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1734 microversion: 2.1 time: 0.150034 Jun 30 18:34:47.692946 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 364/731] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:47 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:34:48.709397 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-8994101d-3cbb-4565-9dc6-09ec9ffa9d3c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:48.710044 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-8994101d-3cbb-4565-9dc6-09ec9ffa9d3c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:48.716568 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8994101d-3cbb-4565-9dc6-09ec9ffa9d3c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:48.717013 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8994101d-3cbb-4565-9dc6-09ec9ffa9d3c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:48.717892 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8994101d-3cbb-4565-9dc6-09ec9ffa9d3c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:48.718323 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8994101d-3cbb-4565-9dc6-09ec9ffa9d3c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:48.851645 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-8994101d-3cbb-4565-9dc6-09ec9ffa9d3c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:48.860124 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-8994101d-3cbb-4565-9dc6-09ec9ffa9d3c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1734 microversion: 2.1 time: 0.154583 Jun 30 18:34:48.860684 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 368/732] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:48 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:34:49.876581 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-276722f2-af4d-4c8e-a899-c6f88ffb4e22 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:49.877180 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-276722f2-af4d-4c8e-a899-c6f88ffb4e22 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:49.883612 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-276722f2-af4d-4c8e-a899-c6f88ffb4e22 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:49.884046 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-276722f2-af4d-4c8e-a899-c6f88ffb4e22 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:49.884789 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-276722f2-af4d-4c8e-a899-c6f88ffb4e22 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:49.885217 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-276722f2-af4d-4c8e-a899-c6f88ffb4e22 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:50.019882 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-276722f2-af4d-4c8e-a899-c6f88ffb4e22 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:50.028050 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-276722f2-af4d-4c8e-a899-c6f88ffb4e22 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1734 microversion: 2.1 time: 0.155578 Jun 30 18:34:50.028624 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 365/733] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:49 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:34:51.045880 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-45d47172-edc0-4b44-a611-952d076707d0 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:51.046600 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-45d47172-edc0-4b44-a611-952d076707d0 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:51.053342 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-45d47172-edc0-4b44-a611-952d076707d0 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:51.053813 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-45d47172-edc0-4b44-a611-952d076707d0 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:51.054554 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-45d47172-edc0-4b44-a611-952d076707d0 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:51.054978 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-45d47172-edc0-4b44-a611-952d076707d0 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:51.183416 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-45d47172-edc0-4b44-a611-952d076707d0 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:51.192329 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-45d47172-edc0-4b44-a611-952d076707d0 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1734 microversion: 2.1 time: 0.150385 Jun 30 18:34:51.192902 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 369/734] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:51 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:34:52.210456 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-a1980410-e8a2-4294-a6d9-68b667b99657 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:52.211064 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-a1980410-e8a2-4294-a6d9-68b667b99657 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:52.217436 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a1980410-e8a2-4294-a6d9-68b667b99657 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:52.217909 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a1980410-e8a2-4294-a6d9-68b667b99657 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:52.218665 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a1980410-e8a2-4294-a6d9-68b667b99657 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:52.219105 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a1980410-e8a2-4294-a6d9-68b667b99657 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:52.345266 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-a1980410-e8a2-4294-a6d9-68b667b99657 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:52.353165 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-a1980410-e8a2-4294-a6d9-68b667b99657 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1734 microversion: 2.1 time: 0.146603 Jun 30 18:34:52.353763 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 366/735] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:52 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:34:53.370325 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-7beeb0d0-cd5d-4f6b-8e8e-5ad92fea0172 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:53.370950 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-7beeb0d0-cd5d-4f6b-8e8e-5ad92fea0172 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:53.378208 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7beeb0d0-cd5d-4f6b-8e8e-5ad92fea0172 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:53.378705 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7beeb0d0-cd5d-4f6b-8e8e-5ad92fea0172 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:53.379463 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7beeb0d0-cd5d-4f6b-8e8e-5ad92fea0172 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:53.379897 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7beeb0d0-cd5d-4f6b-8e8e-5ad92fea0172 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:53.510568 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-7beeb0d0-cd5d-4f6b-8e8e-5ad92fea0172 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:53.519083 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-7beeb0d0-cd5d-4f6b-8e8e-5ad92fea0172 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1734 microversion: 2.1 time: 0.152629 Jun 30 18:34:53.519654 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 370/736] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:53 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:34:54.536743 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-8485b69d-7025-45e1-ad3a-ec3e1421f5e3 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:54.537369 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-8485b69d-7025-45e1-ad3a-ec3e1421f5e3 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:54.544217 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8485b69d-7025-45e1-ad3a-ec3e1421f5e3 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:54.544727 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8485b69d-7025-45e1-ad3a-ec3e1421f5e3 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:54.545559 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8485b69d-7025-45e1-ad3a-ec3e1421f5e3 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:54.546046 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8485b69d-7025-45e1-ad3a-ec3e1421f5e3 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:54.678363 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-8485b69d-7025-45e1-ad3a-ec3e1421f5e3 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:54.686163 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-8485b69d-7025-45e1-ad3a-ec3e1421f5e3 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1734 microversion: 2.1 time: 0.154090 Jun 30 18:34:54.686725 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 367/737] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:54 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:34:55.702839 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-58c6f1f0-c5bc-499e-a041-a3d36c84cf8d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:55.703433 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-58c6f1f0-c5bc-499e-a041-a3d36c84cf8d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:55.710090 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-58c6f1f0-c5bc-499e-a041-a3d36c84cf8d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:55.710523 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-58c6f1f0-c5bc-499e-a041-a3d36c84cf8d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:55.711263 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-58c6f1f0-c5bc-499e-a041-a3d36c84cf8d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:55.711684 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-58c6f1f0-c5bc-499e-a041-a3d36c84cf8d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:55.837520 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-58c6f1f0-c5bc-499e-a041-a3d36c84cf8d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:55.845918 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-58c6f1f0-c5bc-499e-a041-a3d36c84cf8d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1734 microversion: 2.1 time: 0.146911 Jun 30 18:34:55.846511 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 371/738] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:55 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:34:56.862743 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-6b0e560a-8dca-4197-81aa-b620d822d129 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:56.863342 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-6b0e560a-8dca-4197-81aa-b620d822d129 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:56.869713 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6b0e560a-8dca-4197-81aa-b620d822d129 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:56.870148 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6b0e560a-8dca-4197-81aa-b620d822d129 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:56.870891 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6b0e560a-8dca-4197-81aa-b620d822d129 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:56.871318 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6b0e560a-8dca-4197-81aa-b620d822d129 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:57.001539 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-6b0e560a-8dca-4197-81aa-b620d822d129 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:57.009474 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-6b0e560a-8dca-4197-81aa-b620d822d129 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1734 microversion: 2.1 time: 0.150543 Jun 30 18:34:57.010075 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 368/739] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:56 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:34:58.027660 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-f5091857-11c2-49d1-9721-c80b1d17a237 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:58.028274 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-f5091857-11c2-49d1-9721-c80b1d17a237 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:58.037761 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f5091857-11c2-49d1-9721-c80b1d17a237 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:58.038224 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f5091857-11c2-49d1-9721-c80b1d17a237 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:58.038999 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f5091857-11c2-49d1-9721-c80b1d17a237 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:58.039495 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f5091857-11c2-49d1-9721-c80b1d17a237 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:58.172478 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-f5091857-11c2-49d1-9721-c80b1d17a237 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:58.180510 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-f5091857-11c2-49d1-9721-c80b1d17a237 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1734 microversion: 2.1 time: 0.156715 Jun 30 18:34:58.181075 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 372/740] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:58 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:34:59.197373 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-140d8923-750c-4440-9f09-965a01afb6ab tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:34:59.197938 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-140d8923-750c-4440-9f09-965a01afb6ab tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:34:59.204808 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-140d8923-750c-4440-9f09-965a01afb6ab tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:59.205506 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-140d8923-750c-4440-9f09-965a01afb6ab tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:59.206289 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-140d8923-750c-4440-9f09-965a01afb6ab tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:34:59.206725 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-140d8923-750c-4440-9f09-965a01afb6ab tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:34:59.334627 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-140d8923-750c-4440-9f09-965a01afb6ab tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:34:59.342348 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-140d8923-750c-4440-9f09-965a01afb6ab tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1734 microversion: 2.1 time: 0.148976 Jun 30 18:34:59.342917 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 369/741] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:34:59 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:35:00.359827 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-09f4d697-a9ab-4b80-a193-38e33af3e8ac tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:00.361179 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-09f4d697-a9ab-4b80-a193-38e33af3e8ac tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:00.363609 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_api:SELECT=32 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:35:00.368929 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-09f4d697-a9ab-4b80-a193-38e33af3e8ac tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:00.369370 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-09f4d697-a9ab-4b80-a193-38e33af3e8ac tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:00.370163 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-09f4d697-a9ab-4b80-a193-38e33af3e8ac tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:00.370593 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-09f4d697-a9ab-4b80-a193-38e33af3e8ac tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:00.501478 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-09f4d697-a9ab-4b80-a193-38e33af3e8ac tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:00.509398 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-09f4d697-a9ab-4b80-a193-38e33af3e8ac tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1734 microversion: 2.1 time: 0.153343 Jun 30 18:35:00.509990 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 373/742] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:35:00 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:35:01.527570 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-9d746995-b6ac-4ce2-a036-15cc965068bb tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:01.527570 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-9d746995-b6ac-4ce2-a036-15cc965068bb tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:01.534685 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9d746995-b6ac-4ce2-a036-15cc965068bb tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:01.535134 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9d746995-b6ac-4ce2-a036-15cc965068bb tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:01.535896 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9d746995-b6ac-4ce2-a036-15cc965068bb tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:01.536334 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9d746995-b6ac-4ce2-a036-15cc965068bb tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:01.666160 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-9d746995-b6ac-4ce2-a036-15cc965068bb tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:01.674627 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-9d746995-b6ac-4ce2-a036-15cc965068bb tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1714 microversion: 2.1 time: 0.152075 Jun 30 18:35:01.675183 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 370/743] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:35:01 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1714 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:35:01.727632 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-a5003d65-69b0-4e30-9e52-794b80695515 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:01.728120 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-a5003d65-69b0-4e30-9e52-794b80695515 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:01.734405 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a5003d65-69b0-4e30-9e52-794b80695515 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:01.734841 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a5003d65-69b0-4e30-9e52-794b80695515 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:01.736250 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a5003d65-69b0-4e30-9e52-794b80695515 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:01.736669 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a5003d65-69b0-4e30-9e52-794b80695515 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:01.864518 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.wsgi [None req-a5003d65-69b0-4e30-9e52-794b80695515 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] HTTP exception thrown: Cannot 'detach_volume' instance 0048b27f-0b3b-4654-8cf4-27f780ce5e90 while it is in vm_state rescued Jun 30 18:35:01.866321 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-a5003d65-69b0-4e30-9e52-794b80695515 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Request method failure captured: Jun 30 18:35:01.866321 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: request: DELETE /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90/os-volume_attachments/8253391e-4660-4a7d-8011-7f5919c6a661 HTTP/1.1 Jun 30 18:35:01.866321 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept: application/json Jun 30 18:35:01.866321 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept-Encoding: identity Jun 30 18:35:01.866321 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Connection: close Jun 30 18:35:01.866321 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Length: 0 Jun 30 18:35:01.866321 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Type: application/json Jun 30 18:35:01.866321 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Host: 10.222.0.33 Jun 30 18:35:01.866321 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Openstack-System-Scope: None Jun 30 18:35:01.866321 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: User-Agent: python-urllib3/1.26.9 Jun 30 18:35:01.866321 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Auth-Token: gAAAAABivetPoBJVuK1_waLHBdUgEdOXaEr_7pepJLshTowu0y0zEtLsiCOVgrIZcKArCDbekbtcpzpEH-S3F9_gKy-yucVrKZ3vxF5Hhm7_TRqirclJF8mG1hvbjhTpmtvTiqYsOVgnx89AOW01E7ENmFhWdbFyZjBHC046c8-hCFkVolZmamg Jun 30 18:35:01.866321 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Id: None Jun 30 18:35:01.866321 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Name: None Jun 30 18:35:01.866321 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Identity-Status: Confirmed Jun 30 18:35:01.866321 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Is-Admin-Project: True Jun 30 18:35:01.866321 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Id: default Jun 30 18:35:01.866321 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Name: Default Jun 30 18:35:01.866321 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Id: 89156f1867314be89e5108d5506b83a3 Jun 30 18:35:01.866321 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-785753659 Jun 30 18:35:01.866321 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Role: reader,member Jun 30 18:35:01.866321 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Roles: reader,member Jun 30 18:35:01.867876 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89156f1867314be89e5108d5506b83a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_89156f1867314be89e5108d5506b83a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/89156f1867314be89e5108d5506b83a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89156f1867314be89e5108d5506b83a3"}]}] Jun 30 18:35:01.867876 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant: tempest-ServerRescueNegativeTestJSON-785753659 Jun 30 18:35:01.867876 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Id: 89156f1867314be89e5108d5506b83a3 Jun 30 18:35:01.867876 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-785753659 Jun 30 18:35:01.867876 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User: tempest-ServerRescueNegativeTestJSON-785753659-project Jun 30 18:35:01.867876 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Id: default Jun 30 18:35:01.867876 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Name: Default Jun 30 18:35:01.867876 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Id: c66efdb1cc27467d85831617590c8b28 Jun 30 18:35:01.867876 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Name: tempest-ServerRescueNegativeTestJSON-785753659-project Jun 30 18:35:01.867876 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: method: > Jun 30 18:35:01.867876 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: exception: Cannot 'detach_volume' instance 0048b27f-0b3b-4654-8cf4-27f780ce5e90 while it is in vm_state rescued Jun 30 18:35:01.868579 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: action_args: {'server_id': '0048b27f-0b3b-4654-8cf4-27f780ce5e90', 'id': '8253391e-4660-4a7d-8011-7f5919c6a661'} Jun 30 18:35:01.868579 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:35:01.868579 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:35:01.868579 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 30 18:35:01.868579 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 30 18:35:01.868579 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 30 18:35:01.868579 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 30 18:35:01.868579 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 30 18:35:01.868579 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 30 18:35:01.868579 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0048b27f-0b3b-4654-8cf4-27f780ce5e90 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 30 18:35:01.868579 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:35:01.868579 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:35:01.868579 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:35:01.868579 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:35:01.868579 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:35:01.868579 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:35:01.868579 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:35:01.868579 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:35:01.868579 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:35:01.868579 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:35:01.870177 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 30 18:35:01.870177 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 30 18:35:01.870177 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 30 18:35:01.870177 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 30 18:35:01.870177 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 0048b27f-0b3b-4654-8cf4-27f780ce5e90 while it is in vm_state rescued Jun 30 18:35:01.870177 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:35:01.870177 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:35:01.870177 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:35:01.870177 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:35:01.870177 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:35:01.870177 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:35:01.870177 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:35:01.870177 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:35:01.870177 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 0048b27f-0b3b-4654-8cf4-27f780ce5e90 while it is in vm_state rescued Jun 30 18:35:01.870177 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:35:01.870177 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-a5003d65-69b0-4e30-9e52-794b80695515 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Returning 409 to user: Cannot 'detach_volume' instance 0048b27f-0b3b-4654-8cf4-27f780ce5e90 while it is in vm_state rescued {{(pid=117941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:35:01.871480 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-a5003d65-69b0-4e30-9e52-794b80695515 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90/os-volume_attachments/8253391e-4660-4a7d-8011-7f5919c6a661" status: 409 len: 152 microversion: 2.1 time: 0.144060 Jun 30 18:35:01.871480 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 374/744] 10.222.0.33 () {58 vars in 1415 bytes} [Thu Jun 30 18:35:01 2022] DELETE /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90/os-volume_attachments/8253391e-4660-4a7d-8011-7f5919c6a661 => generated 152 bytes in 145 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 30 18:35:01.876746 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-6509cdf6-1770-453c-b1f4-30e59d6554cf tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:35:01.877296 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-6509cdf6-1770-453c-b1f4-30e59d6554cf tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:01.883120 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6509cdf6-1770-453c-b1f4-30e59d6554cf tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:01.883553 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6509cdf6-1770-453c-b1f4-30e59d6554cf tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:01.884294 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6509cdf6-1770-453c-b1f4-30e59d6554cf tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:01.884720 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6509cdf6-1770-453c-b1f4-30e59d6554cf tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:01.948352 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-6509cdf6-1770-453c-b1f4-30e59d6554cf tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "POST /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90/action" status: 202 len: 0 microversion: 2.1 time: 0.075377 Jun 30 18:35:01.948977 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 371/745] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 30 18:35:01 2022] POST /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 18:35:01.958749 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-044e22ec-8dd5-4660-b5f8-050b8e827b6b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:01.959446 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-044e22ec-8dd5-4660-b5f8-050b8e827b6b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:01.966259 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-044e22ec-8dd5-4660-b5f8-050b8e827b6b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:01.966745 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-044e22ec-8dd5-4660-b5f8-050b8e827b6b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:01.967644 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-044e22ec-8dd5-4660-b5f8-050b8e827b6b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:01.968078 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-044e22ec-8dd5-4660-b5f8-050b8e827b6b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:02.104078 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-044e22ec-8dd5-4660-b5f8-050b8e827b6b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:02.112174 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-044e22ec-8dd5-4660-b5f8-050b8e827b6b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1722 microversion: 2.1 time: 0.158808 Jun 30 18:35:02.112734 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 375/746] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:35:01 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:35:03.131194 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-9a5e46d7-5046-45b9-a4a8-90a8412c0692 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:03.131820 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-9a5e46d7-5046-45b9-a4a8-90a8412c0692 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:03.137993 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9a5e46d7-5046-45b9-a4a8-90a8412c0692 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:03.138440 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9a5e46d7-5046-45b9-a4a8-90a8412c0692 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:03.139192 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9a5e46d7-5046-45b9-a4a8-90a8412c0692 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:03.139649 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9a5e46d7-5046-45b9-a4a8-90a8412c0692 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:03.269128 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-9a5e46d7-5046-45b9-a4a8-90a8412c0692 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:03.276972 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-9a5e46d7-5046-45b9-a4a8-90a8412c0692 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1722 microversion: 2.1 time: 0.151344 Jun 30 18:35:03.277537 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 372/747] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:35:03 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:35:04.294419 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-ae5270cf-3144-417b-a1f0-fa3d2630a0d1 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:04.294963 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-ae5270cf-3144-417b-a1f0-fa3d2630a0d1 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:04.302523 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ae5270cf-3144-417b-a1f0-fa3d2630a0d1 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:04.302968 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ae5270cf-3144-417b-a1f0-fa3d2630a0d1 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:04.303714 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ae5270cf-3144-417b-a1f0-fa3d2630a0d1 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:04.304144 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ae5270cf-3144-417b-a1f0-fa3d2630a0d1 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:04.446565 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-ae5270cf-3144-417b-a1f0-fa3d2630a0d1 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:04.457392 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-ae5270cf-3144-417b-a1f0-fa3d2630a0d1 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1722 microversion: 2.1 time: 0.166692 Jun 30 18:35:04.458240 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 376/748] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:35:04 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:35:05.475359 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-b348addc-cc55-4593-8b72-46595d994681 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:05.475950 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-b348addc-cc55-4593-8b72-46595d994681 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:05.482591 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b348addc-cc55-4593-8b72-46595d994681 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:05.483035 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b348addc-cc55-4593-8b72-46595d994681 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:05.483795 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b348addc-cc55-4593-8b72-46595d994681 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:05.484229 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b348addc-cc55-4593-8b72-46595d994681 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:05.625716 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-b348addc-cc55-4593-8b72-46595d994681 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:05.628076 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:35:05.635892 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-b348addc-cc55-4593-8b72-46595d994681 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1728 microversion: 2.1 time: 0.164412 Jun 30 18:35:05.636463 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 373/749] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:35:05 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:35:05.652398 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-102b1ea7-5d4c-4209-aa80-8a78f0886666 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:05.652933 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-102b1ea7-5d4c-4209-aa80-8a78f0886666 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:05.660036 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-102b1ea7-5d4c-4209-aa80-8a78f0886666 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:05.660466 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-102b1ea7-5d4c-4209-aa80-8a78f0886666 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:05.661208 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-102b1ea7-5d4c-4209-aa80-8a78f0886666 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:05.661662 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-102b1ea7-5d4c-4209-aa80-8a78f0886666 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:05.767259 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-102b1ea7-5d4c-4209-aa80-8a78f0886666 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.117823 Jun 30 18:35:05.768030 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 377/750] 10.222.0.33 () {58 vars in 1274 bytes} [Thu Jun 30 18:35:05 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90/os-interface => generated 285 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:35:06.927616 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [req-d37d7c69-830b-45d0-8335-10d9b922091e req-e421b79b-47b3-46ed-a697-5d15004f558d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0048b27f-0b3b-4654-8cf4-27f780ce5e90", "tag": "bdee779b-a164-4712-ad26-219f680c8a30"}]} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:35:06.936840 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-d37d7c69-830b-45d0-8335-10d9b922091e req-e421b79b-47b3-46ed-a697-5d15004f558d service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:06.937281 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-d37d7c69-830b-45d0-8335-10d9b922091e req-e421b79b-47b3-46ed-a697-5d15004f558d service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:06.957053 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.compute.server_external_events [req-d37d7c69-830b-45d0-8335-10d9b922091e req-e421b79b-47b3-46ed-a697-5d15004f558d service nova] Creating event network-changed:bdee779b-a164-4712-ad26-219f680c8a30 for instance 0048b27f-0b3b-4654-8cf4-27f780ce5e90 on hv-cinder-80378 Jun 30 18:35:06.962361 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [req-d37d7c69-830b-45d0-8335-10d9b922091e req-e421b79b-47b3-46ed-a697-5d15004f558d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038733 Jun 30 18:35:06.963149 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 374/751] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:35:08.978608 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-6d3bfa6c-d0ae-4cdb-9a5e-902935070179 req-2c678bce-7a23-417c-9f64-2e841bf72d2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0048b27f-0b3b-4654-8cf4-27f780ce5e90", "tag": "bdee779b-a164-4712-ad26-219f680c8a30"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:35:08.987333 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-6d3bfa6c-d0ae-4cdb-9a5e-902935070179 req-2c678bce-7a23-417c-9f64-2e841bf72d2d service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:08.987767 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-6d3bfa6c-d0ae-4cdb-9a5e-902935070179 req-2c678bce-7a23-417c-9f64-2e841bf72d2d service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:08.991312 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell1:SELECT=88 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:35:08.999137 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.compute.server_external_events [req-6d3bfa6c-d0ae-4cdb-9a5e-902935070179 req-2c678bce-7a23-417c-9f64-2e841bf72d2d service nova] Creating event network-changed:bdee779b-a164-4712-ad26-219f680c8a30 for instance 0048b27f-0b3b-4654-8cf4-27f780ce5e90 on hv-cinder-80378 Jun 30 18:35:09.004563 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-6d3bfa6c-d0ae-4cdb-9a5e-902935070179 req-2c678bce-7a23-417c-9f64-2e841bf72d2d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029503 Jun 30 18:35:09.005139 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 378/752] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:35:15.056948 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:35:15.057533 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Thu Jun 30 18:35:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:35:15.950606 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-ba8a1232-4929-4171-9df9-efdd4be699f8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:15.951173 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-ba8a1232-4929-4171-9df9-efdd4be699f8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:15.953719 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_api:SELECT=26 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:35:15.960178 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ba8a1232-4929-4171-9df9-efdd4be699f8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:15.960611 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ba8a1232-4929-4171-9df9-efdd4be699f8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:15.961353 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ba8a1232-4929-4171-9df9-efdd4be699f8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:15.961814 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ba8a1232-4929-4171-9df9-efdd4be699f8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:15.989481 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-ba8a1232-4929-4171-9df9-efdd4be699f8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9/os-volume_attachments/f0fad95b-ead7-4c66-bc67-38b365ae2830" status: 200 len: 194 microversion: 2.20 time: 0.043138 Jun 30 18:35:15.990106 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 375/753] 10.222.0.33 () {60 vars in 1453 bytes} [Thu Jun 30 18:35:15 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9/os-volume_attachments/f0fad95b-ead7-4c66-bc67-38b365ae2830 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 18:35:16.054392 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-dedd7afb-5179-4dc6-9c35-fa2a38fb1791 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:16.054967 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-dedd7afb-5179-4dc6-9c35-fa2a38fb1791 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:16.061047 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-dedd7afb-5179-4dc6-9c35-fa2a38fb1791 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:16.061644 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-dedd7afb-5179-4dc6-9c35-fa2a38fb1791 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:16.062281 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-dedd7afb-5179-4dc6-9c35-fa2a38fb1791 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:16.062712 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-dedd7afb-5179-4dc6-9c35-fa2a38fb1791 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:16.143580 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.objects.instance [None req-dedd7afb-5179-4dc6-9c35-fa2a38fb1791 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lazy-loading 'services' on Instance uuid 85c4025a-1510-4b69-a54e-94c9864064b9 {{(pid=117941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 18:35:16.256387 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-dedd7afb-5179-4dc6-9c35-fa2a38fb1791 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "DELETE /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9/os-volume_attachments/f0fad95b-ead7-4c66-bc67-38b365ae2830" status: 202 len: 0 microversion: 2.20 time: 0.206823 Jun 30 18:35:16.256961 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 379/754] 10.222.0.33 () {60 vars in 1456 bytes} [Thu Jun 30 18:35:16 2022] DELETE /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9/os-volume_attachments/f0fad95b-ead7-4c66-bc67-38b365ae2830 => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 30 18:35:16.265983 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-d9c02578-d0d0-4bd6-b7dd-35ec5058af5d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:16.267315 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-d9c02578-d0d0-4bd6-b7dd-35ec5058af5d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:16.273280 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d9c02578-d0d0-4bd6-b7dd-35ec5058af5d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:16.273896 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d9c02578-d0d0-4bd6-b7dd-35ec5058af5d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:16.274782 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d9c02578-d0d0-4bd6-b7dd-35ec5058af5d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:16.275274 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d9c02578-d0d0-4bd6-b7dd-35ec5058af5d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:16.307560 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-d9c02578-d0d0-4bd6-b7dd-35ec5058af5d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046199 Jun 30 18:35:16.308122 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 376/755] 10.222.0.33 () {60 vars in 1342 bytes} [Thu Jun 30 18:35:16 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 18:35:17.321036 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-38bb81ab-401e-4aab-a2c8-6fe094288bac tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:17.322271 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-38bb81ab-401e-4aab-a2c8-6fe094288bac tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:17.329018 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-38bb81ab-401e-4aab-a2c8-6fe094288bac tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:17.329453 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-38bb81ab-401e-4aab-a2c8-6fe094288bac tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:17.330397 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-38bb81ab-401e-4aab-a2c8-6fe094288bac tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:17.330943 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-38bb81ab-401e-4aab-a2c8-6fe094288bac tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:17.361835 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-38bb81ab-401e-4aab-a2c8-6fe094288bac tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045192 Jun 30 18:35:17.362390 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 380/756] 10.222.0.33 () {60 vars in 1342 bytes} [Thu Jun 30 18:35:17 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 18:35:18.373530 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-313dda5e-f135-4d3e-9242-28fc3fe347c8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:18.374406 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-313dda5e-f135-4d3e-9242-28fc3fe347c8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:18.381925 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-313dda5e-f135-4d3e-9242-28fc3fe347c8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:18.382368 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-313dda5e-f135-4d3e-9242-28fc3fe347c8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:18.383116 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-313dda5e-f135-4d3e-9242-28fc3fe347c8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:18.383544 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-313dda5e-f135-4d3e-9242-28fc3fe347c8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:18.412441 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-313dda5e-f135-4d3e-9242-28fc3fe347c8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042968 Jun 30 18:35:18.412983 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 377/757] 10.222.0.33 () {60 vars in 1342 bytes} [Thu Jun 30 18:35:18 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:35:18.468391 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-62e00210-674f-4ffb-915c-1d8c82a54671 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:18.468908 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-62e00210-674f-4ffb-915c-1d8c82a54671 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:18.475278 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-62e00210-674f-4ffb-915c-1d8c82a54671 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:18.475714 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-62e00210-674f-4ffb-915c-1d8c82a54671 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:18.476453 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-62e00210-674f-4ffb-915c-1d8c82a54671 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:18.476871 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-62e00210-674f-4ffb-915c-1d8c82a54671 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:18.500992 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-62e00210-674f-4ffb-915c-1d8c82a54671 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Going to try to terminate instance {{(pid=117941) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 18:35:18.573565 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-62e00210-674f-4ffb-915c-1d8c82a54671 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "DELETE /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 204 len: 0 microversion: 2.20 time: 0.108616 Jun 30 18:35:18.574556 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 381/758] 10.222.0.33 () {60 vars in 1279 bytes} [Thu Jun 30 18:35:18 2022] DELETE /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 30 18:35:18.583343 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-acd7370e-5a1d-4de1-9e20-ae8f77626681 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:18.583974 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-acd7370e-5a1d-4de1-9e20-ae8f77626681 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:18.589921 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-acd7370e-5a1d-4de1-9e20-ae8f77626681 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:18.590365 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-acd7370e-5a1d-4de1-9e20-ae8f77626681 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:18.591114 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-acd7370e-5a1d-4de1-9e20-ae8f77626681 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:18.591547 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-acd7370e-5a1d-4de1-9e20-ae8f77626681 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:18.724081 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-acd7370e-5a1d-4de1-9e20-ae8f77626681 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:18.731837 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-acd7370e-5a1d-4de1-9e20-ae8f77626681 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:18.733325 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-acd7370e-5a1d-4de1-9e20-ae8f77626681 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:18.734515 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-acd7370e-5a1d-4de1-9e20-ae8f77626681 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1723 microversion: 2.20 time: 0.155425 Jun 30 18:35:18.735064 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 378/759] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:35:18 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:35:19.753512 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-4a1610e2-abc6-4b1a-81fa-ac76a8455835 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:19.754507 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-4a1610e2-abc6-4b1a-81fa-ac76a8455835 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:19.761009 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-4a1610e2-abc6-4b1a-81fa-ac76a8455835 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:19.761448 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-4a1610e2-abc6-4b1a-81fa-ac76a8455835 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:19.762242 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-4a1610e2-abc6-4b1a-81fa-ac76a8455835 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:19.762674 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-4a1610e2-abc6-4b1a-81fa-ac76a8455835 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:19.889234 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-4a1610e2-abc6-4b1a-81fa-ac76a8455835 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:19.897660 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-4a1610e2-abc6-4b1a-81fa-ac76a8455835 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:19.899146 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-4a1610e2-abc6-4b1a-81fa-ac76a8455835 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:19.900300 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-4a1610e2-abc6-4b1a-81fa-ac76a8455835 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1723 microversion: 2.20 time: 0.151073 Jun 30 18:35:19.900848 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 382/760] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:35:19 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:35:20.918592 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-5381d39d-bcec-4e48-b5ef-f1dc7d4b81cd tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:20.919325 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-5381d39d-bcec-4e48-b5ef-f1dc7d4b81cd tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:20.925911 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5381d39d-bcec-4e48-b5ef-f1dc7d4b81cd tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:20.926361 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5381d39d-bcec-4e48-b5ef-f1dc7d4b81cd tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:20.927131 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5381d39d-bcec-4e48-b5ef-f1dc7d4b81cd tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:20.927566 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5381d39d-bcec-4e48-b5ef-f1dc7d4b81cd tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:21.071695 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-5381d39d-bcec-4e48-b5ef-f1dc7d4b81cd tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:21.083546 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-5381d39d-bcec-4e48-b5ef-f1dc7d4b81cd tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:21.085455 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-5381d39d-bcec-4e48-b5ef-f1dc7d4b81cd tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:21.087304 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-5381d39d-bcec-4e48-b5ef-f1dc7d4b81cd tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1723 microversion: 2.20 time: 0.172590 Jun 30 18:35:21.087886 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 379/761] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:35:20 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:35:21.917521 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-79bbb6b8-0074-4fb8-98a6-1ecf2c8720ed req-6b355c99-2f97-4730-b5e0-d67fee2be116 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85c4025a-1510-4b69-a54e-94c9864064b9", "name": "network-vif-deleted", "tag": "82ef2cd7-f1a8-48a7-bd5b-c0babc56b244"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:35:21.933630 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-79bbb6b8-0074-4fb8-98a6-1ecf2c8720ed req-6b355c99-2f97-4730-b5e0-d67fee2be116 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:21.934414 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-79bbb6b8-0074-4fb8-98a6-1ecf2c8720ed req-6b355c99-2f97-4730-b5e0-d67fee2be116 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:21.946764 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.compute.server_external_events [req-79bbb6b8-0074-4fb8-98a6-1ecf2c8720ed req-6b355c99-2f97-4730-b5e0-d67fee2be116 service nova] Creating event network-vif-deleted:82ef2cd7-f1a8-48a7-bd5b-c0babc56b244 for instance 85c4025a-1510-4b69-a54e-94c9864064b9 on hv-cinder-80378 Jun 30 18:35:21.952674 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-79bbb6b8-0074-4fb8-98a6-1ecf2c8720ed req-6b355c99-2f97-4730-b5e0-d67fee2be116 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038888 Jun 30 18:35:21.953616 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 383/762] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:35:22.107168 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-0b29584f-8836-447c-bc53-6b3822140334 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:22.108397 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-0b29584f-8836-447c-bc53-6b3822140334 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:22.115476 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0b29584f-8836-447c-bc53-6b3822140334 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:22.116154 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0b29584f-8836-447c-bc53-6b3822140334 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:22.116912 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0b29584f-8836-447c-bc53-6b3822140334 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:22.117348 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0b29584f-8836-447c-bc53-6b3822140334 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:22.148747 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0b29584f-8836-447c-bc53-6b3822140334 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:22.149194 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0b29584f-8836-447c-bc53-6b3822140334 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:22.149668 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.objects.instance [None req-0b29584f-8836-447c-bc53-6b3822140334 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lazy-loading 'fault' on Instance uuid 85c4025a-1510-4b69-a54e-94c9864064b9 {{(pid=117940) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 18:35:22.190601 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-0b29584f-8836-447c-bc53-6b3822140334 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:22.198741 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-0b29584f-8836-447c-bc53-6b3822140334 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:22.200238 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-0b29584f-8836-447c-bc53-6b3822140334 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:22.201392 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-0b29584f-8836-447c-bc53-6b3822140334 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 200 len: 1372 microversion: 2.20 time: 0.098384 Jun 30 18:35:22.201991 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 380/763] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:35:22 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 1372 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:35:23.222571 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-bc91197a-af38-46ce-b8d3-93d5a6f96c88 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:23.223385 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-bc91197a-af38-46ce-b8d3-93d5a6f96c88 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:23.230089 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-bc91197a-af38-46ce-b8d3-93d5a6f96c88 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:23.230533 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-bc91197a-af38-46ce-b8d3-93d5a6f96c88 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:23.231316 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-bc91197a-af38-46ce-b8d3-93d5a6f96c88 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:23.231755 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-bc91197a-af38-46ce-b8d3-93d5a6f96c88 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:23.246808 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.wsgi [None req-bc91197a-af38-46ce-b8d3-93d5a6f96c88 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] HTTP exception thrown: Instance 85c4025a-1510-4b69-a54e-94c9864064b9 could not be found. Jun 30 18:35:23.248458 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-bc91197a-af38-46ce-b8d3-93d5a6f96c88 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Request method failure captured: Jun 30 18:35:23.248458 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: request: GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 HTTP/1.1 Jun 30 18:35:23.248458 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept: application/json Jun 30 18:35:23.248458 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept-Encoding: identity Jun 30 18:35:23.248458 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Connection: close Jun 30 18:35:23.248458 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Length: 0 Jun 30 18:35:23.248458 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Type: application/json Jun 30 18:35:23.248458 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Host: 10.222.0.33 Jun 30 18:35:23.248458 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Openstack-System-Scope: None Jun 30 18:35:23.248458 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: User-Agent: python-urllib3/1.26.9 Jun 30 18:35:23.248458 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Auth-Token: gAAAAABivetSuQOwT4vFm5flZxm1eDj6M2nBWqWHKgsP9UECOLhkByjFxHVfqDcxNK6adn6a-YDjDfHkfGsNXlIBYKd0OcH0-no2so9YWdT32bQRPtKlQyVnMoYhXOYtW_-G8k_q0VBToOERLvKQaEkefnpYN9VwvtR1bJY5F6jVS-tnLtYrNkI Jun 30 18:35:23.248458 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Id: None Jun 30 18:35:23.248458 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Name: None Jun 30 18:35:23.248458 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Identity-Status: Confirmed Jun 30 18:35:23.248458 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Is-Admin-Project: True Jun 30 18:35:23.248458 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 18:35:23.248458 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Id: default Jun 30 18:35:23.248458 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Name: Default Jun 30 18:35:23.248458 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Id: f643222ab6194191979d2e884f5ed75a Jun 30 18:35:23.248458 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-72931025 Jun 30 18:35:23.248458 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Role: reader,member Jun 30 18:35:23.248458 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Roles: reader,member Jun 30 18:35:23.250246 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f643222ab6194191979d2e884f5ed75a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f643222ab6194191979d2e884f5ed75a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f643222ab6194191979d2e884f5ed75a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f643222ab6194191979d2e884f5ed75a"}]}] Jun 30 18:35:23.250246 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant: tempest-AttachVolumeShelveTestJSON-72931025 Jun 30 18:35:23.250246 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Id: f643222ab6194191979d2e884f5ed75a Jun 30 18:35:23.250246 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-72931025 Jun 30 18:35:23.250246 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User: tempest-AttachVolumeShelveTestJSON-72931025-project Jun 30 18:35:23.250246 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Id: default Jun 30 18:35:23.250246 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Name: Default Jun 30 18:35:23.250246 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Id: f13e9e1bf5084d08919845767c70c3f7 Jun 30 18:35:23.250246 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Name: tempest-AttachVolumeShelveTestJSON-72931025-project Jun 30 18:35:23.250246 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: method: > Jun 30 18:35:23.250246 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: exception: Instance 85c4025a-1510-4b69-a54e-94c9864064b9 could not be found. Jun 30 18:35:23.250246 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: action_args: {'id': '85c4025a-1510-4b69-a54e-94c9864064b9'} Jun 30 18:35:23.251124 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:35:23.251124 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:35:23.251124 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:35:23.251124 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:35:23.251124 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:35:23.251124 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:35:23.251124 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:35:23.251124 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:35:23.251124 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:35:23.251124 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:35:23.251124 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85c4025a-1510-4b69-a54e-94c9864064b9 could not be found. Jun 30 18:35:23.251124 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:35:23.251124 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:35:23.251124 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:35:23.251124 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:35:23.251124 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:35:23.251124 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:35:23.251124 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:35:23.251124 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:35:23.251124 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:35:23.252966 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:35:23.252966 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:35:23.252966 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:35:23.252966 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:35:23.252966 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:35:23.252966 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:35:23.252966 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:35:23.252966 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85c4025a-1510-4b69-a54e-94c9864064b9 could not be found. Jun 30 18:35:23.252966 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:35:23.252966 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:35:23.252966 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:35:23.252966 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:35:23.252966 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:35:23.252966 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:35:23.252966 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:35:23.252966 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:35:23.252966 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85c4025a-1510-4b69-a54e-94c9864064b9 could not be found. Jun 30 18:35:23.252966 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:35:23.254144 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-bc91197a-af38-46ce-b8d3-93d5a6f96c88 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Returning 404 to user: Instance 85c4025a-1510-4b69-a54e-94c9864064b9 could not be found. {{(pid=117941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:35:23.254144 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-bc91197a-af38-46ce-b8d3-93d5a6f96c88 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 404 len: 111 microversion: 2.20 time: 0.032987 Jun 30 18:35:23.254144 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 384/764] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:35:23 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 30 18:35:23.259819 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-209762e9-887e-4c50-a55d-4c52199bec55 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '.version_select at 0x7f1804bb9550>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:23.282319 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-209762e9-887e-4c50-a55d-4c52199bec55 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1538822077" status: 204 len: 0 microversion: 2.20 time: 0.026479 Jun 30 18:35:23.283813 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 381/765] 10.222.0.33 () {60 vars in 1261 bytes} [Thu Jun 30 18:35:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1538822077 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 30 18:35:23.944575 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-11dac3eb-409d-4f69-9e7c-2d303eb50747 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Action: 'create', calling method: .version_select at 0x7f1809406820>, body: {"keypair": {"name": "tempest-keypair-1875162518", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyBuYadnZ0Du++1c6iiR2zWDvTTNp93Gz3+AymAiYMTiIXRT+mjNBXzbDc5GohR2JSesfLTS1CJKCiuUQ+pGVmP9SMNiJcUfTmqV0c3R/0Lyb0XHwUXAln+es1d2m6f4g=="}} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:35:23.959971 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.quota [None req-11dac3eb-409d-4f69-9e7c-2d303eb50747 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Getting quotas for project f643222ab6194191979d2e884f5ed75a. Resources: {'key_pairs'} {{(pid=117941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 18:35:23.963673 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.quota [None req-11dac3eb-409d-4f69-9e7c-2d303eb50747 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Getting quotas for user f13e9e1bf5084d08919845767c70c3f7 and project f643222ab6194191979d2e884f5ed75a. Resources: {'key_pairs'} {{(pid=117941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 18:35:23.989945 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-11dac3eb-409d-4f69-9e7c-2d303eb50747 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.049043 Jun 30 18:35:23.995733 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 385/766] 10.222.0.33 () {62 vars in 1199 bytes} [Thu Jun 30 18:35:23 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 56 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 30 18:35:25.402575 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-643f4595-d46a-4207-827d-8379405b278b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-630701178", "imageRef": "636d6d52-5033-47e1-bf75-0b4fc50c0bb0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e55638a8-911c-429f-af75-dce85c8efa6d"}], "security_groups": [{"name": "tempest-securitygroup--2043937148"}], "key_name": "tempest-keypair-1875162518", "user_data": "}} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:35:25.502838 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.network.neutron [None req-643f4595-d46a-4207-827d-8379405b278b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] validate_networks() for [('e55638a8-911c-429f-af75-dce85c8efa6d', None, None, None, None, None)] {{(pid=117940) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 18:35:25.873386 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-643f4595-d46a-4207-827d-8379405b278b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Flavor limits 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 18:35:25.873840 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-643f4595-d46a-4207-827d-8379405b278b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Image limits 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 18:35:25.874311 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-643f4595-d46a-4207-827d-8379405b278b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Flavor pref 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 18:35:25.874719 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-643f4595-d46a-4207-827d-8379405b278b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Image pref 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 18:35:25.875129 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-643f4595-d46a-4207-827d-8379405b278b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 18:35:25.884276 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-643f4595-d46a-4207-827d-8379405b278b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:25.884712 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-643f4595-d46a-4207-827d-8379405b278b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:25.885489 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-643f4595-d46a-4207-827d-8379405b278b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:25.885968 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-643f4595-d46a-4207-827d-8379405b278b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:25.903118 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.quota [None req-643f4595-d46a-4207-827d-8379405b278b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Getting quotas for project f643222ab6194191979d2e884f5ed75a. Resources: {'ram', 'instances', 'cores'} {{(pid=117940) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 18:35:25.907029 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.quota [None req-643f4595-d46a-4207-827d-8379405b278b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Getting quotas for user f13e9e1bf5084d08919845767c70c3f7 and project f643222ab6194191979d2e884f5ed75a. Resources: {'ram', 'instances', 'cores'} {{(pid=117940) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 18:35:25.918523 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-643f4595-d46a-4207-827d-8379405b278b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Going to run 1 instances... {{(pid=117940) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 18:35:25.920760 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-643f4595-d46a-4207-827d-8379405b278b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='636d6d52-5033-47e1-bf75-0b4fc50c0bb0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117940) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 18:35:25.966141 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-643f4595-d46a-4207-827d-8379405b278b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.568037 Jun 30 18:35:25.966788 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 382/767] 10.222.0.33 () {62 vars in 1187 bytes} [Thu Jun 30 18:35:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 30 18:35:25.977985 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-a1c01477-b9dd-4678-b7d6-86910fc18d69 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:25.978583 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-a1c01477-b9dd-4678-b7d6-86910fc18d69 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:26.037084 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-a1c01477-b9dd-4678-b7d6-86910fc18d69 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:26.045065 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-a1c01477-b9dd-4678-b7d6-86910fc18d69 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:26.046574 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-a1c01477-b9dd-4678-b7d6-86910fc18d69 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:26.047797 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-a1c01477-b9dd-4678-b7d6-86910fc18d69 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1281 microversion: 2.20 time: 0.074219 Jun 30 18:35:26.048578 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 386/768] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:35:25 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1281 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:35:26.785318 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-facedb9d-7d72-4643-9a97-600288e8145b tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:26.785862 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-facedb9d-7d72-4643-9a97-600288e8145b tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:26.791819 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-facedb9d-7d72-4643-9a97-600288e8145b tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:26.792257 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-facedb9d-7d72-4643-9a97-600288e8145b tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:26.792997 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-facedb9d-7d72-4643-9a97-600288e8145b tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:26.793420 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-facedb9d-7d72-4643-9a97-600288e8145b tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:26.877533 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.objects.instance [None req-facedb9d-7d72-4643-9a97-600288e8145b tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lazy-loading 'services' on Instance uuid 2e559236-fa0a-4378-b21f-e5f5e669751d {{(pid=117940) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 18:35:26.950636 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-facedb9d-7d72-4643-9a97-600288e8145b tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d/os-volume_attachments/45d427a9-731d-477d-aa68-a038d74eb318" status: 202 len: 0 microversion: 2.1 time: 0.266055 Jun 30 18:35:26.951245 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 383/769] 10.222.0.33 () {58 vars in 1415 bytes} [Thu Jun 30 18:35:26 2022] DELETE /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d/os-volume_attachments/45d427a9-731d-477d-aa68-a038d74eb318 => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 18:35:27.066744 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-f7cd3f99-8343-4b34-8816-de43dc9a8ae7 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:27.067884 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-f7cd3f99-8343-4b34-8816-de43dc9a8ae7 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:27.074752 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f7cd3f99-8343-4b34-8816-de43dc9a8ae7 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:27.075598 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f7cd3f99-8343-4b34-8816-de43dc9a8ae7 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:27.076696 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f7cd3f99-8343-4b34-8816-de43dc9a8ae7 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:27.077315 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f7cd3f99-8343-4b34-8816-de43dc9a8ae7 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:27.147705 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-f7cd3f99-8343-4b34-8816-de43dc9a8ae7 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:27.155603 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-f7cd3f99-8343-4b34-8816-de43dc9a8ae7 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:27.157089 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-f7cd3f99-8343-4b34-8816-de43dc9a8ae7 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:27.158359 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-f7cd3f99-8343-4b34-8816-de43dc9a8ae7 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1351 microversion: 2.20 time: 0.096262 Jun 30 18:35:27.158915 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 387/770] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:35:27 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1351 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:35:28.182112 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-d7f0568e-87c4-4397-bc11-96ec3494b392 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:28.184444 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-d7f0568e-87c4-4397-bc11-96ec3494b392 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:28.194637 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d7f0568e-87c4-4397-bc11-96ec3494b392 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:28.195310 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d7f0568e-87c4-4397-bc11-96ec3494b392 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:28.196097 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d7f0568e-87c4-4397-bc11-96ec3494b392 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:28.196528 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d7f0568e-87c4-4397-bc11-96ec3494b392 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:28.351271 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-d7f0568e-87c4-4397-bc11-96ec3494b392 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:28.359622 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-d7f0568e-87c4-4397-bc11-96ec3494b392 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:28.361171 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-d7f0568e-87c4-4397-bc11-96ec3494b392 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:28.362358 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-d7f0568e-87c4-4397-bc11-96ec3494b392 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1407 microversion: 2.20 time: 0.189745 Jun 30 18:35:28.362922 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 384/771] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:35:28 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:35:28.890986 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-461a4e51-c337-4c0a-8fc3-f28eb477d552 req-053d44bb-e11e-438b-87f8-3d69eeaaf52d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2c839c4-5e9d-433d-ac94-1d8f3f0875e3", "tag": "c81ef70e-10e5-414c-8ee1-71b2bd8320c9"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:35:28.901079 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-461a4e51-c337-4c0a-8fc3-f28eb477d552 req-053d44bb-e11e-438b-87f8-3d69eeaaf52d service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:28.901773 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-461a4e51-c337-4c0a-8fc3-f28eb477d552 req-053d44bb-e11e-438b-87f8-3d69eeaaf52d service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:28.916913 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.compute.server_external_events [req-461a4e51-c337-4c0a-8fc3-f28eb477d552 req-053d44bb-e11e-438b-87f8-3d69eeaaf52d service nova] Creating event network-changed:c81ef70e-10e5-414c-8ee1-71b2bd8320c9 for instance a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 on hv-cinder-80378 Jun 30 18:35:28.921761 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-461a4e51-c337-4c0a-8fc3-f28eb477d552 req-053d44bb-e11e-438b-87f8-3d69eeaaf52d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034394 Jun 30 18:35:28.922358 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 388/772] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:35:29.131244 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-c1322a14-ed40-400d-b29f-163e70376dad tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:35:29.137235 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c1322a14-ed40-400d-b29f-163e70376dad tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:29.137714 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c1322a14-ed40-400d-b29f-163e70376dad tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:29.164153 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-c1322a14-ed40-400d-b29f-163e70376dad tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Going to try to stop instance {{(pid=117940) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 30 18:35:29.213090 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-c1322a14-ed40-400d-b29f-163e70376dad tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "POST /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d/action" status: 202 len: 0 microversion: 2.1 time: 0.085707 Jun 30 18:35:29.214095 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 385/773] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 30 18:35:29 2022] POST /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 18:35:29.223615 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-5a3a0ba9-6e47-4777-b2e9-f17361141152 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:29.224558 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-5a3a0ba9-6e47-4777-b2e9-f17361141152 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:29.231493 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-5a3a0ba9-6e47-4777-b2e9-f17361141152 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:29.232010 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-5a3a0ba9-6e47-4777-b2e9-f17361141152 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:29.233136 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-5a3a0ba9-6e47-4777-b2e9-f17361141152 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:29.233560 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-5a3a0ba9-6e47-4777-b2e9-f17361141152 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:29.372036 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-5a3a0ba9-6e47-4777-b2e9-f17361141152 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:29.381105 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-5a3a0ba9-6e47-4777-b2e9-f17361141152 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1677 microversion: 2.1 time: 0.162589 Jun 30 18:35:29.381354 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-16f42fa4-bfc0-4dd1-b086-8e32005de655 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:29.382191 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 389/774] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:35:29 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:35:29.391299 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-16f42fa4-bfc0-4dd1-b086-8e32005de655 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:29.398408 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-16f42fa4-bfc0-4dd1-b086-8e32005de655 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:29.398900 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-16f42fa4-bfc0-4dd1-b086-8e32005de655 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:29.399679 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-16f42fa4-bfc0-4dd1-b086-8e32005de655 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:29.400110 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-16f42fa4-bfc0-4dd1-b086-8e32005de655 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:29.531051 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-16f42fa4-bfc0-4dd1-b086-8e32005de655 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:29.539339 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-16f42fa4-bfc0-4dd1-b086-8e32005de655 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:29.540829 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-16f42fa4-bfc0-4dd1-b086-8e32005de655 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:29.541981 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-16f42fa4-bfc0-4dd1-b086-8e32005de655 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1407 microversion: 2.20 time: 0.165449 Jun 30 18:35:29.542540 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 386/775] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:35:29 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 18:35:30.398982 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-256fbd65-395b-4e50-80f0-1a80abb41a9d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:30.399516 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-256fbd65-395b-4e50-80f0-1a80abb41a9d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:30.401903 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:35:30.407485 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-256fbd65-395b-4e50-80f0-1a80abb41a9d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:30.407926 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-256fbd65-395b-4e50-80f0-1a80abb41a9d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:30.409606 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-256fbd65-395b-4e50-80f0-1a80abb41a9d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:30.410041 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-256fbd65-395b-4e50-80f0-1a80abb41a9d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:30.544875 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-256fbd65-395b-4e50-80f0-1a80abb41a9d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:30.552383 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-256fbd65-395b-4e50-80f0-1a80abb41a9d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1677 microversion: 2.1 time: 0.157286 Jun 30 18:35:30.552956 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 390/776] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:35:30 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:35:30.559960 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-75a352eb-d1a6-4c5f-b6ad-a1aeca558c5f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:30.560559 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-75a352eb-d1a6-4c5f-b6ad-a1aeca558c5f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:30.567039 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-75a352eb-d1a6-4c5f-b6ad-a1aeca558c5f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:30.567476 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-75a352eb-d1a6-4c5f-b6ad-a1aeca558c5f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:30.568216 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-75a352eb-d1a6-4c5f-b6ad-a1aeca558c5f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:30.568639 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-75a352eb-d1a6-4c5f-b6ad-a1aeca558c5f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:30.700849 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-75a352eb-d1a6-4c5f-b6ad-a1aeca558c5f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:30.709365 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-75a352eb-d1a6-4c5f-b6ad-a1aeca558c5f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:30.710870 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-75a352eb-d1a6-4c5f-b6ad-a1aeca558c5f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:30.711951 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-75a352eb-d1a6-4c5f-b6ad-a1aeca558c5f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1407 microversion: 2.20 time: 0.155801 Jun 30 18:35:30.712506 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 387/777] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:35:30 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:35:31.569808 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-46a9bd55-03b1-499c-8c0f-4832b01de8bb tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:31.570422 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-46a9bd55-03b1-499c-8c0f-4832b01de8bb tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:31.576867 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-46a9bd55-03b1-499c-8c0f-4832b01de8bb tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:31.577309 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-46a9bd55-03b1-499c-8c0f-4832b01de8bb tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:31.578097 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-46a9bd55-03b1-499c-8c0f-4832b01de8bb tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:31.578531 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-46a9bd55-03b1-499c-8c0f-4832b01de8bb tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:31.709967 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-46a9bd55-03b1-499c-8c0f-4832b01de8bb tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:31.717291 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-46a9bd55-03b1-499c-8c0f-4832b01de8bb tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1677 microversion: 2.1 time: 0.151395 Jun 30 18:35:31.717901 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 391/778] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:35:31 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:35:31.730505 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-e0197f43-8804-4023-a9c6-e0324831defe tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:31.731104 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-e0197f43-8804-4023-a9c6-e0324831defe tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:31.737963 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e0197f43-8804-4023-a9c6-e0324831defe tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:31.738400 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e0197f43-8804-4023-a9c6-e0324831defe tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:31.739141 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e0197f43-8804-4023-a9c6-e0324831defe tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:31.739565 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e0197f43-8804-4023-a9c6-e0324831defe tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:31.904877 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-e0197f43-8804-4023-a9c6-e0324831defe tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:31.913121 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-e0197f43-8804-4023-a9c6-e0324831defe tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:31.914577 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-e0197f43-8804-4023-a9c6-e0324831defe tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:31.916310 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-e0197f43-8804-4023-a9c6-e0324831defe tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1407 microversion: 2.20 time: 0.189601 Jun 30 18:35:31.917052 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 388/779] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:35:31 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:35:32.734540 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-636e6ec5-aaa0-48a9-b202-c017710d2f9c tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:32.735148 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-636e6ec5-aaa0-48a9-b202-c017710d2f9c tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:32.742745 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-636e6ec5-aaa0-48a9-b202-c017710d2f9c tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:32.743192 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-636e6ec5-aaa0-48a9-b202-c017710d2f9c tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:32.743948 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-636e6ec5-aaa0-48a9-b202-c017710d2f9c tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:32.744380 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-636e6ec5-aaa0-48a9-b202-c017710d2f9c tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:32.872277 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-636e6ec5-aaa0-48a9-b202-c017710d2f9c tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:32.879670 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-636e6ec5-aaa0-48a9-b202-c017710d2f9c tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1677 microversion: 2.1 time: 0.148951 Jun 30 18:35:32.880226 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 392/780] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:35:32 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:35:32.935110 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-6398c049-6a95-490a-a226-b72d51da99d1 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:32.935859 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-6398c049-6a95-490a-a226-b72d51da99d1 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:32.942400 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6398c049-6a95-490a-a226-b72d51da99d1 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:32.942845 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6398c049-6a95-490a-a226-b72d51da99d1 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:32.943599 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6398c049-6a95-490a-a226-b72d51da99d1 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:32.944033 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6398c049-6a95-490a-a226-b72d51da99d1 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:33.085822 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-6398c049-6a95-490a-a226-b72d51da99d1 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:33.093906 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-6398c049-6a95-490a-a226-b72d51da99d1 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:33.095386 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-6398c049-6a95-490a-a226-b72d51da99d1 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:33.097290 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-6398c049-6a95-490a-a226-b72d51da99d1 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1407 microversion: 2.20 time: 0.166035 Jun 30 18:35:33.097894 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 389/781] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:35:32 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 18:35:33.896600 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-7e71e83f-e13b-469f-97a4-6d180109b37d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:33.897138 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-7e71e83f-e13b-469f-97a4-6d180109b37d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:33.903506 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7e71e83f-e13b-469f-97a4-6d180109b37d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:33.903950 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7e71e83f-e13b-469f-97a4-6d180109b37d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:33.904710 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7e71e83f-e13b-469f-97a4-6d180109b37d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:33.905141 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7e71e83f-e13b-469f-97a4-6d180109b37d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:34.032086 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-7e71e83f-e13b-469f-97a4-6d180109b37d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:34.040258 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-7e71e83f-e13b-469f-97a4-6d180109b37d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1677 microversion: 2.1 time: 0.147704 Jun 30 18:35:34.040817 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 393/782] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:35:33 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:35:34.115446 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-36bd43b5-ac05-4634-a500-bc96f30b6ea8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:34.116056 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-36bd43b5-ac05-4634-a500-bc96f30b6ea8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:34.122649 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-36bd43b5-ac05-4634-a500-bc96f30b6ea8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:34.123095 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-36bd43b5-ac05-4634-a500-bc96f30b6ea8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:34.123855 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-36bd43b5-ac05-4634-a500-bc96f30b6ea8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:34.124290 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-36bd43b5-ac05-4634-a500-bc96f30b6ea8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:34.256611 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-36bd43b5-ac05-4634-a500-bc96f30b6ea8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:34.258878 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:35:34.265895 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-36bd43b5-ac05-4634-a500-bc96f30b6ea8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:34.267378 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-36bd43b5-ac05-4634-a500-bc96f30b6ea8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:34.268470 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-36bd43b5-ac05-4634-a500-bc96f30b6ea8 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1407 microversion: 2.20 time: 0.157199 Jun 30 18:35:34.269510 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 390/783] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:35:34 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:35:34.483066 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-10389965-707b-4d34-ad2e-04d55df04e0c req-00089670-0151-4ae4-9dac-16c7070a1198 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2c839c4-5e9d-433d-ac94-1d8f3f0875e3", "name": "network-vif-plugged", "status": "completed", "tag": "c81ef70e-10e5-414c-8ee1-71b2bd8320c9"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:35:34.491183 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-10389965-707b-4d34-ad2e-04d55df04e0c req-00089670-0151-4ae4-9dac-16c7070a1198 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:34.491663 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-10389965-707b-4d34-ad2e-04d55df04e0c req-00089670-0151-4ae4-9dac-16c7070a1198 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:34.505060 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.compute.server_external_events [req-10389965-707b-4d34-ad2e-04d55df04e0c req-00089670-0151-4ae4-9dac-16c7070a1198 service nova] Creating event network-vif-plugged:c81ef70e-10e5-414c-8ee1-71b2bd8320c9 for instance a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 on hv-cinder-80378 Jun 30 18:35:34.509968 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-10389965-707b-4d34-ad2e-04d55df04e0c req-00089670-0151-4ae4-9dac-16c7070a1198 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030622 Jun 30 18:35:34.510561 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 394/784] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:35:35.058201 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-76f20010-f81d-46f5-96d5-cd1d14186de1 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:35.058804 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-76f20010-f81d-46f5-96d5-cd1d14186de1 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:35.065380 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-76f20010-f81d-46f5-96d5-cd1d14186de1 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:35.065886 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-76f20010-f81d-46f5-96d5-cd1d14186de1 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:35.067864 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-76f20010-f81d-46f5-96d5-cd1d14186de1 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:35.068329 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-76f20010-f81d-46f5-96d5-cd1d14186de1 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:35.199081 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-76f20010-f81d-46f5-96d5-cd1d14186de1 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:35.206779 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-76f20010-f81d-46f5-96d5-cd1d14186de1 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1677 microversion: 2.1 time: 0.152975 Jun 30 18:35:35.207605 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 391/785] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:35:35 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:35:35.289318 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-2c750f2b-59a0-4981-bef8-5df07850e95f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:35.289960 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-2c750f2b-59a0-4981-bef8-5df07850e95f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:35.296084 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2c750f2b-59a0-4981-bef8-5df07850e95f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:35.296518 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2c750f2b-59a0-4981-bef8-5df07850e95f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:35.297251 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2c750f2b-59a0-4981-bef8-5df07850e95f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:35.297696 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2c750f2b-59a0-4981-bef8-5df07850e95f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:35.427471 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-2c750f2b-59a0-4981-bef8-5df07850e95f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:35.435284 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-2c750f2b-59a0-4981-bef8-5df07850e95f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:35.436769 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-2c750f2b-59a0-4981-bef8-5df07850e95f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:35.437888 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-2c750f2b-59a0-4981-bef8-5df07850e95f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1407 microversion: 2.20 time: 0.154347 Jun 30 18:35:35.438442 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 395/786] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:35:35 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:35:36.223901 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-cbbb1fcc-32b5-4b46-a163-954d1328a5f5 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:36.224533 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-cbbb1fcc-32b5-4b46-a163-954d1328a5f5 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:36.226389 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell0:SELECT=2 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:35:36.227036 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell0:SELECT=6 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:35:36.233671 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cbbb1fcc-32b5-4b46-a163-954d1328a5f5 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:36.234111 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cbbb1fcc-32b5-4b46-a163-954d1328a5f5 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:36.234858 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cbbb1fcc-32b5-4b46-a163-954d1328a5f5 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:36.235286 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cbbb1fcc-32b5-4b46-a163-954d1328a5f5 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:36.370363 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-cbbb1fcc-32b5-4b46-a163-954d1328a5f5 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:36.377748 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-cbbb1fcc-32b5-4b46-a163-954d1328a5f5 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1677 microversion: 2.1 time: 0.157628 Jun 30 18:35:36.378312 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 392/787] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:35:36 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:35:36.455676 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-af40d4eb-b85f-4ea9-a678-48bf4506fe7c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:36.456270 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-af40d4eb-b85f-4ea9-a678-48bf4506fe7c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:36.458574 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell0:SELECT=6 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:35:36.464818 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-af40d4eb-b85f-4ea9-a678-48bf4506fe7c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:36.465262 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-af40d4eb-b85f-4ea9-a678-48bf4506fe7c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:36.466059 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-af40d4eb-b85f-4ea9-a678-48bf4506fe7c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:36.466483 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-af40d4eb-b85f-4ea9-a678-48bf4506fe7c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:36.603091 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-af40d4eb-b85f-4ea9-a678-48bf4506fe7c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:36.610807 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-af40d4eb-b85f-4ea9-a678-48bf4506fe7c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:36.612273 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-af40d4eb-b85f-4ea9-a678-48bf4506fe7c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:36.614160 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-af40d4eb-b85f-4ea9-a678-48bf4506fe7c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1599 microversion: 2.20 time: 0.162116 Jun 30 18:35:36.614704 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 396/788] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:35:36 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1599 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:35:36.631969 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-3c0ebba6-084e-4a74-a16e-aa1bd934d816 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:36.632455 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-3c0ebba6-084e-4a74-a16e-aa1bd934d816 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:36.638299 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3c0ebba6-084e-4a74-a16e-aa1bd934d816 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:36.638734 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3c0ebba6-084e-4a74-a16e-aa1bd934d816 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:36.639474 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3c0ebba6-084e-4a74-a16e-aa1bd934d816 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:36.639898 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3c0ebba6-084e-4a74-a16e-aa1bd934d816 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:36.716235 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-3c0ebba6-084e-4a74-a16e-aa1bd934d816 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.088728 Jun 30 18:35:36.716836 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 393/789] 10.222.0.33 () {60 vars in 1315 bytes} [Thu Jun 30 18:35:36 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 18:35:37.396099 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-e4019177-0603-4ccb-8027-8c8ae0478d23 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:37.397209 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-e4019177-0603-4ccb-8027-8c8ae0478d23 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:37.403366 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e4019177-0603-4ccb-8027-8c8ae0478d23 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:37.403809 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e4019177-0603-4ccb-8027-8c8ae0478d23 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:37.404560 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e4019177-0603-4ccb-8027-8c8ae0478d23 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:37.404986 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e4019177-0603-4ccb-8027-8c8ae0478d23 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:37.581436 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-e4019177-0603-4ccb-8027-8c8ae0478d23 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:37.585179 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:35:37.590529 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-e4019177-0603-4ccb-8027-8c8ae0478d23 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1677 microversion: 2.1 time: 0.198844 Jun 30 18:35:37.591105 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 397/790] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:35:37 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1677 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:35:37.974104 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [req-43fa79c4-5472-42b7-bcad-3a23ba810505 req-0ecce542-1611-448f-bb2b-3f5afa0daff5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2c839c4-5e9d-433d-ac94-1d8f3f0875e3", "tag": "c81ef70e-10e5-414c-8ee1-71b2bd8320c9"}]} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:35:37.982095 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-43fa79c4-5472-42b7-bcad-3a23ba810505 req-0ecce542-1611-448f-bb2b-3f5afa0daff5 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:37.982525 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-43fa79c4-5472-42b7-bcad-3a23ba810505 req-0ecce542-1611-448f-bb2b-3f5afa0daff5 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:37.993192 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.compute.server_external_events [req-43fa79c4-5472-42b7-bcad-3a23ba810505 req-0ecce542-1611-448f-bb2b-3f5afa0daff5 service nova] Creating event network-changed:c81ef70e-10e5-414c-8ee1-71b2bd8320c9 for instance a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 on hv-cinder-80378 Jun 30 18:35:37.998145 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [req-43fa79c4-5472-42b7-bcad-3a23ba810505 req-0ecce542-1611-448f-bb2b-3f5afa0daff5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029052 Jun 30 18:35:37.998896 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 394/791] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:35:38.608096 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-deda0f6f-0eb1-4797-bcf4-c25562a6106f tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:38.608695 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-deda0f6f-0eb1-4797-bcf4-c25562a6106f tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:38.616538 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-deda0f6f-0eb1-4797-bcf4-c25562a6106f tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:38.616992 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-deda0f6f-0eb1-4797-bcf4-c25562a6106f tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:38.617806 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-deda0f6f-0eb1-4797-bcf4-c25562a6106f tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:38.618230 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-deda0f6f-0eb1-4797-bcf4-c25562a6106f tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:38.755536 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-deda0f6f-0eb1-4797-bcf4-c25562a6106f tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:38.763714 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-deda0f6f-0eb1-4797-bcf4-c25562a6106f tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1677 microversion: 2.1 time: 0.159321 Jun 30 18:35:38.764291 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 398/792] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:35:38 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:35:39.783438 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-c1a2ef28-03fa-4f16-9a41-e32e63170be0 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:39.784121 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-c1a2ef28-03fa-4f16-9a41-e32e63170be0 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:39.790714 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c1a2ef28-03fa-4f16-9a41-e32e63170be0 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:39.791154 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c1a2ef28-03fa-4f16-9a41-e32e63170be0 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:39.791902 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c1a2ef28-03fa-4f16-9a41-e32e63170be0 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:39.792330 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c1a2ef28-03fa-4f16-9a41-e32e63170be0 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:39.930443 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-c1a2ef28-03fa-4f16-9a41-e32e63170be0 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:39.937783 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-c1a2ef28-03fa-4f16-9a41-e32e63170be0 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1677 microversion: 2.1 time: 0.158983 Jun 30 18:35:39.938363 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 395/793] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:35:39 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:35:40.954614 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-9c314351-397e-407e-b442-c5d326737627 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:40.955243 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-9c314351-397e-407e-b442-c5d326737627 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:40.962171 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9c314351-397e-407e-b442-c5d326737627 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:40.962608 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9c314351-397e-407e-b442-c5d326737627 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:40.963350 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9c314351-397e-407e-b442-c5d326737627 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:40.963772 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9c314351-397e-407e-b442-c5d326737627 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:41.091325 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-9c314351-397e-407e-b442-c5d326737627 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:41.098889 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-9c314351-397e-407e-b442-c5d326737627 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1677 microversion: 2.1 time: 0.148088 Jun 30 18:35:41.099392 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 399/794] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:35:40 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:35:42.116147 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-42f053a7-65d5-48dc-8bb1-10a6813087d7 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:42.116754 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-42f053a7-65d5-48dc-8bb1-10a6813087d7 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:42.123385 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-42f053a7-65d5-48dc-8bb1-10a6813087d7 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:42.123829 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-42f053a7-65d5-48dc-8bb1-10a6813087d7 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:42.124588 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-42f053a7-65d5-48dc-8bb1-10a6813087d7 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:42.125019 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-42f053a7-65d5-48dc-8bb1-10a6813087d7 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:42.260430 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-42f053a7-65d5-48dc-8bb1-10a6813087d7 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:42.267774 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-42f053a7-65d5-48dc-8bb1-10a6813087d7 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1677 microversion: 2.1 time: 0.155689 Jun 30 18:35:42.268336 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 396/795] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:35:42 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:35:43.286183 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-f984d54e-2ad1-424d-905c-3c51b567d1cf tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:43.286770 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-f984d54e-2ad1-424d-905c-3c51b567d1cf tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:43.293339 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f984d54e-2ad1-424d-905c-3c51b567d1cf tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:43.293738 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f984d54e-2ad1-424d-905c-3c51b567d1cf tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:43.294495 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f984d54e-2ad1-424d-905c-3c51b567d1cf tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:43.294926 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f984d54e-2ad1-424d-905c-3c51b567d1cf tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:43.423037 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-f984d54e-2ad1-424d-905c-3c51b567d1cf tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:43.430496 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-f984d54e-2ad1-424d-905c-3c51b567d1cf tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1677 microversion: 2.1 time: 0.148846 Jun 30 18:35:43.431092 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 400/796] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:35:43 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:35:44.447583 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-b9e576b6-0694-4ed2-92c1-7ee0a9b4f36a tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:44.448121 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-b9e576b6-0694-4ed2-92c1-7ee0a9b4f36a tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:44.454626 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b9e576b6-0694-4ed2-92c1-7ee0a9b4f36a tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:44.455074 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b9e576b6-0694-4ed2-92c1-7ee0a9b4f36a tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:44.455835 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b9e576b6-0694-4ed2-92c1-7ee0a9b4f36a tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:44.456273 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b9e576b6-0694-4ed2-92c1-7ee0a9b4f36a tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:44.594559 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-b9e576b6-0694-4ed2-92c1-7ee0a9b4f36a tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:44.602562 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-b9e576b6-0694-4ed2-92c1-7ee0a9b4f36a tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1677 microversion: 2.1 time: 0.158997 Jun 30 18:35:44.603128 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 397/797] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:35:44 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:35:45.620331 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-6485ce89-ca52-4c8f-8e2e-878b36221f47 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:45.620937 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-6485ce89-ca52-4c8f-8e2e-878b36221f47 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:45.627476 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6485ce89-ca52-4c8f-8e2e-878b36221f47 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:45.627920 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6485ce89-ca52-4c8f-8e2e-878b36221f47 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:45.628668 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6485ce89-ca52-4c8f-8e2e-878b36221f47 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:45.629097 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6485ce89-ca52-4c8f-8e2e-878b36221f47 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:45.762641 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-6485ce89-ca52-4c8f-8e2e-878b36221f47 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:45.769958 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-6485ce89-ca52-4c8f-8e2e-878b36221f47 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1654 microversion: 2.1 time: 0.153419 Jun 30 18:35:45.770583 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 401/798] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:35:45 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1654 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:35:45.788722 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-99f0833e-7691-49b4-8cb8-75a1433be022 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:35:45.795150 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-99f0833e-7691-49b4-8cb8-75a1433be022 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:45.795587 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-99f0833e-7691-49b4-8cb8-75a1433be022 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:45.817249 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-99f0833e-7691-49b4-8cb8-75a1433be022 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Going to try to start instance {{(pid=117940) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 30 18:35:45.859148 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-99f0833e-7691-49b4-8cb8-75a1433be022 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "POST /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d/action" status: 202 len: 0 microversion: 2.1 time: 0.075682 Jun 30 18:35:45.860055 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 398/799] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 30 18:35:45 2022] POST /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 18:35:45.869100 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-d7cef7a8-a60c-402b-bd8d-6c1fe02a5964 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:45.869964 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-d7cef7a8-a60c-402b-bd8d-6c1fe02a5964 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:45.876713 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d7cef7a8-a60c-402b-bd8d-6c1fe02a5964 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:45.877169 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d7cef7a8-a60c-402b-bd8d-6c1fe02a5964 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:45.880433 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d7cef7a8-a60c-402b-bd8d-6c1fe02a5964 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:45.881422 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d7cef7a8-a60c-402b-bd8d-6c1fe02a5964 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:46.012207 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-d7cef7a8-a60c-402b-bd8d-6c1fe02a5964 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:46.019669 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-d7cef7a8-a60c-402b-bd8d-6c1fe02a5964 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1663 microversion: 2.1 time: 0.154500 Jun 30 18:35:46.020244 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 402/800] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:35:45 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1663 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:35:47.038864 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-377edee0-bcd8-4de3-b6af-59edca5f8c52 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:47.039559 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-377edee0-bcd8-4de3-b6af-59edca5f8c52 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:47.041462 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:35:47.046928 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-377edee0-bcd8-4de3-b6af-59edca5f8c52 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:47.047371 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-377edee0-bcd8-4de3-b6af-59edca5f8c52 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:47.048129 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-377edee0-bcd8-4de3-b6af-59edca5f8c52 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:47.048560 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-377edee0-bcd8-4de3-b6af-59edca5f8c52 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:47.184017 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-377edee0-bcd8-4de3-b6af-59edca5f8c52 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:47.191355 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-377edee0-bcd8-4de3-b6af-59edca5f8c52 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1663 microversion: 2.1 time: 0.157805 Jun 30 18:35:47.191917 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 399/801] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:35:47 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1663 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:35:48.209553 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-c2c26439-b3b9-4f67-a796-48d1431245e6 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:48.210190 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-c2c26439-b3b9-4f67-a796-48d1431245e6 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:48.216717 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c2c26439-b3b9-4f67-a796-48d1431245e6 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:48.217159 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c2c26439-b3b9-4f67-a796-48d1431245e6 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:48.217947 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c2c26439-b3b9-4f67-a796-48d1431245e6 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:48.218377 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c2c26439-b3b9-4f67-a796-48d1431245e6 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:48.348602 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-c2c26439-b3b9-4f67-a796-48d1431245e6 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:48.356202 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-c2c26439-b3b9-4f67-a796-48d1431245e6 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1667 microversion: 2.1 time: 0.151176 Jun 30 18:35:48.356767 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 403/802] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:35:48 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1667 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:36:01.966609 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-91053927-3ae8-4be2-882e-0af39797586c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:36:01.967153 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-91053927-3ae8-4be2-882e-0af39797586c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:36:01.969246 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_api:SELECT=1 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:36:01.970078 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:36:01.975867 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-91053927-3ae8-4be2-882e-0af39797586c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:01.976310 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-91053927-3ae8-4be2-882e-0af39797586c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:01.977070 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-91053927-3ae8-4be2-882e-0af39797586c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:01.977508 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-91053927-3ae8-4be2-882e-0af39797586c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:02.059274 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.objects.instance [None req-91053927-3ae8-4be2-882e-0af39797586c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lazy-loading 'services' on Instance uuid 0048b27f-0b3b-4654-8cf4-27f780ce5e90 {{(pid=117940) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 18:36:02.130913 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-91053927-3ae8-4be2-882e-0af39797586c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90/os-volume_attachments/8253391e-4660-4a7d-8011-7f5919c6a661" status: 202 len: 0 microversion: 2.1 time: 0.167401 Jun 30 18:36:02.131561 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 400/803] 10.222.0.33 () {58 vars in 1415 bytes} [Thu Jun 30 18:36:01 2022] DELETE /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90/os-volume_attachments/8253391e-4660-4a7d-8011-7f5919c6a661 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 18:36:02.139875 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-b107ce35-4018-4a05-8352-acefb9d356fe tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:36:02.140785 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-b107ce35-4018-4a05-8352-acefb9d356fe tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:36:02.143370 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_api:SELECT=27 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:36:02.144388 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell1:SELECT=37 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:36:02.150107 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b107ce35-4018-4a05-8352-acefb9d356fe tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:02.150577 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b107ce35-4018-4a05-8352-acefb9d356fe tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:02.151351 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b107ce35-4018-4a05-8352-acefb9d356fe tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:02.151758 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b107ce35-4018-4a05-8352-acefb9d356fe tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:02.183585 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-b107ce35-4018-4a05-8352-acefb9d356fe tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047557 Jun 30 18:36:02.184054 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 404/804] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 30 18:36:02 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:36:03.196712 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-00e18189-7406-497b-bedd-039a52fdd922 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:36:03.197802 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-00e18189-7406-497b-bedd-039a52fdd922 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:36:03.203963 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-00e18189-7406-497b-bedd-039a52fdd922 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:03.204403 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-00e18189-7406-497b-bedd-039a52fdd922 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:03.205159 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-00e18189-7406-497b-bedd-039a52fdd922 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:03.205604 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-00e18189-7406-497b-bedd-039a52fdd922 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:03.234868 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-00e18189-7406-497b-bedd-039a52fdd922 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043362 Jun 30 18:36:03.235418 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 401/805] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 30 18:36:03 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 18:36:03.321915 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-e96a9af0-be9f-48ef-bc64-203a56c751a7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:36:03.322468 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-e96a9af0-be9f-48ef-bc64-203a56c751a7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:36:03.328759 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e96a9af0-be9f-48ef-bc64-203a56c751a7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:03.329208 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e96a9af0-be9f-48ef-bc64-203a56c751a7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:03.329990 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e96a9af0-be9f-48ef-bc64-203a56c751a7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:03.330425 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e96a9af0-be9f-48ef-bc64-203a56c751a7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:03.357014 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-e96a9af0-be9f-48ef-bc64-203a56c751a7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Going to try to terminate instance {{(pid=117941) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 18:36:03.430955 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-e96a9af0-be9f-48ef-bc64-203a56c751a7 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 204 len: 0 microversion: 2.1 time: 0.112489 Jun 30 18:36:03.431636 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 405/806] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 30 18:36:03 2022] DELETE /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 18:36:03.440633 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-15ed83ae-7549-4d46-af12-f64587129c0b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:36:03.441240 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-15ed83ae-7549-4d46-af12-f64587129c0b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:36:03.447494 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-15ed83ae-7549-4d46-af12-f64587129c0b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:03.447935 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-15ed83ae-7549-4d46-af12-f64587129c0b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:03.448675 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-15ed83ae-7549-4d46-af12-f64587129c0b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:03.449100 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-15ed83ae-7549-4d46-af12-f64587129c0b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:03.583297 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-15ed83ae-7549-4d46-af12-f64587129c0b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:36:03.590905 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-15ed83ae-7549-4d46-af12-f64587129c0b tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1688 microversion: 2.1 time: 0.154276 Jun 30 18:36:03.591465 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 402/807] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:36:03 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:36:04.608493 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-56d55ed8-384d-4483-8ce4-21d7024cba24 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:36:04.609187 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-56d55ed8-384d-4483-8ce4-21d7024cba24 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:36:04.616543 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-56d55ed8-384d-4483-8ce4-21d7024cba24 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:04.616988 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-56d55ed8-384d-4483-8ce4-21d7024cba24 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:04.617770 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-56d55ed8-384d-4483-8ce4-21d7024cba24 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:04.618227 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-56d55ed8-384d-4483-8ce4-21d7024cba24 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:04.744808 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-56d55ed8-384d-4483-8ce4-21d7024cba24 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:36:04.752213 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-56d55ed8-384d-4483-8ce4-21d7024cba24 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1688 microversion: 2.1 time: 0.147981 Jun 30 18:36:04.752768 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 406/808] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:36:04 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1688 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:36:05.769134 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-fca409b6-210d-4204-b0b0-6163e86e77a0 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:36:05.769764 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-fca409b6-210d-4204-b0b0-6163e86e77a0 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:36:05.776120 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fca409b6-210d-4204-b0b0-6163e86e77a0 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:05.776558 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fca409b6-210d-4204-b0b0-6163e86e77a0 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:05.777303 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fca409b6-210d-4204-b0b0-6163e86e77a0 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:05.777761 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fca409b6-210d-4204-b0b0-6163e86e77a0 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:05.902963 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-fca409b6-210d-4204-b0b0-6163e86e77a0 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:36:05.910260 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-fca409b6-210d-4204-b0b0-6163e86e77a0 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1688 microversion: 2.1 time: 0.144954 Jun 30 18:36:05.910809 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 403/809] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:36:05 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1688 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:36:06.928668 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-56dbad0b-f436-4a00-8fc3-dd3085968ce1 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:36:06.929277 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-56dbad0b-f436-4a00-8fc3-dd3085968ce1 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:36:06.935848 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-56dbad0b-f436-4a00-8fc3-dd3085968ce1 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:06.936290 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-56dbad0b-f436-4a00-8fc3-dd3085968ce1 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:06.937043 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-56dbad0b-f436-4a00-8fc3-dd3085968ce1 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:06.937473 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-56dbad0b-f436-4a00-8fc3-dd3085968ce1 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:07.072391 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-56dbad0b-f436-4a00-8fc3-dd3085968ce1 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:36:07.079705 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-56dbad0b-f436-4a00-8fc3-dd3085968ce1 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1688 microversion: 2.1 time: 0.156118 Jun 30 18:36:07.080268 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 407/810] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:36:06 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:36:08.098066 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-35889a58-5f13-4497-b975-729919eef028 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:36:08.099695 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-35889a58-5f13-4497-b975-729919eef028 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:36:08.106783 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-35889a58-5f13-4497-b975-729919eef028 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:08.107238 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-35889a58-5f13-4497-b975-729919eef028 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:08.108019 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-35889a58-5f13-4497-b975-729919eef028 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:08.108738 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-35889a58-5f13-4497-b975-729919eef028 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:08.161046 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-fa7f20dd-6218-4039-bb0c-443a84f589bb req-c90aaf3e-197f-4ceb-9c90-81c077cdf45a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0048b27f-0b3b-4654-8cf4-27f780ce5e90", "name": "network-vif-deleted", "tag": "bdee779b-a164-4712-ad26-219f680c8a30"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:36:08.170992 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-fa7f20dd-6218-4039-bb0c-443a84f589bb req-c90aaf3e-197f-4ceb-9c90-81c077cdf45a service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:08.171758 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-fa7f20dd-6218-4039-bb0c-443a84f589bb req-c90aaf3e-197f-4ceb-9c90-81c077cdf45a service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:08.186465 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.compute.server_external_events [req-fa7f20dd-6218-4039-bb0c-443a84f589bb req-c90aaf3e-197f-4ceb-9c90-81c077cdf45a service nova] Creating event network-vif-deleted:bdee779b-a164-4712-ad26-219f680c8a30 for instance 0048b27f-0b3b-4654-8cf4-27f780ce5e90 on hv-cinder-80378 Jun 30 18:36:08.190452 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-35889a58-5f13-4497-b975-729919eef028 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:36:08.192401 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-fa7f20dd-6218-4039-bb0c-443a84f589bb req-c90aaf3e-197f-4ceb-9c90-81c077cdf45a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035480 Jun 30 18:36:08.193771 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 408/811] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:36:08.198594 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-35889a58-5f13-4497-b975-729919eef028 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 200 len: 1621 microversion: 2.1 time: 0.104376 Jun 30 18:36:08.207911 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 404/812] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:36:08 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 1621 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:36:09.216892 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-b5698db4-4b36-4d20-90c6-33c359fdff8e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:36:09.217678 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-b5698db4-4b36-4d20-90c6-33c359fdff8e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 0048b27f-0b3b-4654-8cf4-27f780ce5e90] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:36:09.226643 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b5698db4-4b36-4d20-90c6-33c359fdff8e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:09.227089 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b5698db4-4b36-4d20-90c6-33c359fdff8e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:09.227854 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b5698db4-4b36-4d20-90c6-33c359fdff8e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:09.228283 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b5698db4-4b36-4d20-90c6-33c359fdff8e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:09.243570 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.wsgi [None req-b5698db4-4b36-4d20-90c6-33c359fdff8e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] HTTP exception thrown: Instance 0048b27f-0b3b-4654-8cf4-27f780ce5e90 could not be found. Jun 30 18:36:09.245225 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-b5698db4-4b36-4d20-90c6-33c359fdff8e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Request method failure captured: Jun 30 18:36:09.245225 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: request: GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 HTTP/1.1 Jun 30 18:36:09.245225 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept: application/json Jun 30 18:36:09.245225 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept-Encoding: identity Jun 30 18:36:09.245225 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Connection: close Jun 30 18:36:09.245225 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Length: 0 Jun 30 18:36:09.245225 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Type: application/json Jun 30 18:36:09.245225 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Host: 10.222.0.33 Jun 30 18:36:09.245225 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Openstack-System-Scope: None Jun 30 18:36:09.245225 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: User-Agent: python-urllib3/1.26.9 Jun 30 18:36:09.245225 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Auth-Token: gAAAAABivetPoBJVuK1_waLHBdUgEdOXaEr_7pepJLshTowu0y0zEtLsiCOVgrIZcKArCDbekbtcpzpEH-S3F9_gKy-yucVrKZ3vxF5Hhm7_TRqirclJF8mG1hvbjhTpmtvTiqYsOVgnx89AOW01E7ENmFhWdbFyZjBHC046c8-hCFkVolZmamg Jun 30 18:36:09.245225 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Id: None Jun 30 18:36:09.245225 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Name: None Jun 30 18:36:09.245225 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Identity-Status: Confirmed Jun 30 18:36:09.245225 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Is-Admin-Project: True Jun 30 18:36:09.245225 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Id: default Jun 30 18:36:09.245225 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Name: Default Jun 30 18:36:09.245225 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Id: 89156f1867314be89e5108d5506b83a3 Jun 30 18:36:09.245225 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-785753659 Jun 30 18:36:09.245225 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Role: reader,member Jun 30 18:36:09.245225 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Roles: reader,member Jun 30 18:36:09.246716 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89156f1867314be89e5108d5506b83a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_89156f1867314be89e5108d5506b83a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/89156f1867314be89e5108d5506b83a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89156f1867314be89e5108d5506b83a3"}]}] Jun 30 18:36:09.246716 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant: tempest-ServerRescueNegativeTestJSON-785753659 Jun 30 18:36:09.246716 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Id: 89156f1867314be89e5108d5506b83a3 Jun 30 18:36:09.246716 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-785753659 Jun 30 18:36:09.246716 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User: tempest-ServerRescueNegativeTestJSON-785753659-project Jun 30 18:36:09.246716 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Id: default Jun 30 18:36:09.246716 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Name: Default Jun 30 18:36:09.246716 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Id: c66efdb1cc27467d85831617590c8b28 Jun 30 18:36:09.246716 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Name: tempest-ServerRescueNegativeTestJSON-785753659-project Jun 30 18:36:09.246716 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: method: > Jun 30 18:36:09.246716 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: exception: Instance 0048b27f-0b3b-4654-8cf4-27f780ce5e90 could not be found. Jun 30 18:36:09.246716 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: action_args: {'id': '0048b27f-0b3b-4654-8cf4-27f780ce5e90'} Jun 30 18:36:09.247498 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:36:09.247498 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:36:09.247498 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:36:09.247498 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:36:09.247498 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:36:09.247498 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:36:09.247498 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:36:09.247498 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:36:09.247498 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:36:09.247498 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:36:09.247498 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0048b27f-0b3b-4654-8cf4-27f780ce5e90 could not be found. Jun 30 18:36:09.247498 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:36:09.247498 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:36:09.247498 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:36:09.247498 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:36:09.247498 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:36:09.247498 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:36:09.247498 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:36:09.247498 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:36:09.247498 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:36:09.249416 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:36:09.249416 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:36:09.249416 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:36:09.249416 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:36:09.249416 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:36:09.249416 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:36:09.249416 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:36:09.249416 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0048b27f-0b3b-4654-8cf4-27f780ce5e90 could not be found. Jun 30 18:36:09.249416 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:36:09.249416 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:36:09.249416 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:36:09.249416 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:36:09.249416 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:36:09.249416 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:36:09.249416 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:36:09.249416 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:36:09.249416 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0048b27f-0b3b-4654-8cf4-27f780ce5e90 could not be found. Jun 30 18:36:09.249416 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:36:09.251904 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-b5698db4-4b36-4d20-90c6-33c359fdff8e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Returning 404 to user: Instance 0048b27f-0b3b-4654-8cf4-27f780ce5e90 could not be found. {{(pid=117941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:36:09.251904 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-b5698db4-4b36-4d20-90c6-33c359fdff8e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90" status: 404 len: 111 microversion: 2.1 time: 0.034831 Jun 30 18:36:09.251904 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 409/813] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:36:09 2022] GET /compute/v2.1/servers/0048b27f-0b3b-4654-8cf4-27f780ce5e90 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:36:09.255951 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-e62ca83d-ae80-40d4-a86c-3173acb2b94c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '.version_select at 0x7f1804c38550>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:36:09.275782 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-e62ca83d-ae80-40d4-a86c-3173acb2b94c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-779206522" status: 202 len: 0 microversion: 2.1 time: 0.023660 Jun 30 18:36:09.276357 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 405/814] 10.222.0.33 () {58 vars in 1217 bytes} [Thu Jun 30 18:36:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-779206522 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 18:36:12.130002 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-aa263971-ce51-46c2-a319-0e8da544468c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:36:12.131516 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-aa263971-ce51-46c2-a319-0e8da544468c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:36:12.137381 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-aa263971-ce51-46c2-a319-0e8da544468c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:12.137867 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-aa263971-ce51-46c2-a319-0e8da544468c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:12.138613 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-aa263971-ce51-46c2-a319-0e8da544468c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:12.139033 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-aa263971-ce51-46c2-a319-0e8da544468c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:12.164568 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-aa263971-ce51-46c2-a319-0e8da544468c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Going to try to terminate instance {{(pid=117941) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 18:36:12.239437 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-aa263971-ce51-46c2-a319-0e8da544468c tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 204 len: 0 microversion: 2.1 time: 0.112868 Jun 30 18:36:12.240659 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 410/815] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 30 18:36:12 2022] DELETE /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 18:36:12.250551 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-177c5ffe-4e11-413c-8024-db4f5a775d1e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:36:12.252225 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-177c5ffe-4e11-413c-8024-db4f5a775d1e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:36:12.260843 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-177c5ffe-4e11-413c-8024-db4f5a775d1e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:12.261289 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-177c5ffe-4e11-413c-8024-db4f5a775d1e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:12.262071 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-177c5ffe-4e11-413c-8024-db4f5a775d1e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:12.262507 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-177c5ffe-4e11-413c-8024-db4f5a775d1e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:12.393882 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-177c5ffe-4e11-413c-8024-db4f5a775d1e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:36:12.401126 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-177c5ffe-4e11-413c-8024-db4f5a775d1e tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1507 microversion: 2.1 time: 0.155845 Jun 30 18:36:12.401704 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 406/816] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:36:12 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:36:13.419446 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-4d2ee4a6-fe46-4a79-a7a4-a963e88f910d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:36:13.420213 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-4d2ee4a6-fe46-4a79-a7a4-a963e88f910d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:36:13.426619 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-4d2ee4a6-fe46-4a79-a7a4-a963e88f910d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:13.427058 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-4d2ee4a6-fe46-4a79-a7a4-a963e88f910d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:13.428410 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-4d2ee4a6-fe46-4a79-a7a4-a963e88f910d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:13.428837 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-4d2ee4a6-fe46-4a79-a7a4-a963e88f910d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:13.517602 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-4d2ee4a6-fe46-4a79-a7a4-a963e88f910d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:36:13.527000 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-4d2ee4a6-fe46-4a79-a7a4-a963e88f910d tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 200 len: 1465 microversion: 2.1 time: 0.111182 Jun 30 18:36:13.528616 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 411/817] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:36:13 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 1465 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:36:13.531068 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [req-5f393b2b-8099-4086-acac-c5e165cf28b6 req-261b4b54-ae4b-4ca7-9279-a255d7c49de3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5df6e0a7-4daa-4bb9-943a-69462fa6bcfd", "name": "network-vif-deleted", "tag": "31020119-788a-4b78-a365-ced788236b04"}]} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:36:13.540858 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-5f393b2b-8099-4086-acac-c5e165cf28b6 req-261b4b54-ae4b-4ca7-9279-a255d7c49de3 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:13.541061 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-5f393b2b-8099-4086-acac-c5e165cf28b6 req-261b4b54-ae4b-4ca7-9279-a255d7c49de3 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:13.553448 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.compute.server_external_events [req-5f393b2b-8099-4086-acac-c5e165cf28b6 req-261b4b54-ae4b-4ca7-9279-a255d7c49de3 service nova] Creating event network-vif-deleted:31020119-788a-4b78-a365-ced788236b04 for instance 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd on hv-cinder-80378 Jun 30 18:36:13.559032 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [req-5f393b2b-8099-4086-acac-c5e165cf28b6 req-261b4b54-ae4b-4ca7-9279-a255d7c49de3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031510 Jun 30 18:36:13.559635 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 407/818] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:36:14.543886 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-c54f429f-ad27-4cfe-9d6f-0da5a10ca080 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:36:14.544500 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-c54f429f-ad27-4cfe-9d6f-0da5a10ca080 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:36:14.550990 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c54f429f-ad27-4cfe-9d6f-0da5a10ca080 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:14.551432 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c54f429f-ad27-4cfe-9d6f-0da5a10ca080 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:14.552187 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c54f429f-ad27-4cfe-9d6f-0da5a10ca080 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:14.553915 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c54f429f-ad27-4cfe-9d6f-0da5a10ca080 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:14.567701 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.wsgi [None req-c54f429f-ad27-4cfe-9d6f-0da5a10ca080 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] HTTP exception thrown: Instance 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd could not be found. Jun 30 18:36:14.570056 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-c54f429f-ad27-4cfe-9d6f-0da5a10ca080 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Request method failure captured: Jun 30 18:36:14.570056 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: request: GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd HTTP/1.1 Jun 30 18:36:14.570056 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept: application/json Jun 30 18:36:14.570056 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept-Encoding: identity Jun 30 18:36:14.570056 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Connection: close Jun 30 18:36:14.570056 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Length: 0 Jun 30 18:36:14.570056 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Type: application/json Jun 30 18:36:14.570056 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Host: 10.222.0.33 Jun 30 18:36:14.570056 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Openstack-System-Scope: None Jun 30 18:36:14.570056 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: User-Agent: python-urllib3/1.26.9 Jun 30 18:36:14.570056 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Auth-Token: gAAAAABivetPoBJVuK1_waLHBdUgEdOXaEr_7pepJLshTowu0y0zEtLsiCOVgrIZcKArCDbekbtcpzpEH-S3F9_gKy-yucVrKZ3vxF5Hhm7_TRqirclJF8mG1hvbjhTpmtvTiqYsOVgnx89AOW01E7ENmFhWdbFyZjBHC046c8-hCFkVolZmamg Jun 30 18:36:14.570056 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Id: None Jun 30 18:36:14.570056 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Name: None Jun 30 18:36:14.570056 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Identity-Status: Confirmed Jun 30 18:36:14.570056 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Is-Admin-Project: True Jun 30 18:36:14.570056 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Id: default Jun 30 18:36:14.570056 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Name: Default Jun 30 18:36:14.570056 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Id: 89156f1867314be89e5108d5506b83a3 Jun 30 18:36:14.570056 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-785753659 Jun 30 18:36:14.570056 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Role: reader,member Jun 30 18:36:14.570056 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Roles: reader,member Jun 30 18:36:14.571680 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89156f1867314be89e5108d5506b83a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_89156f1867314be89e5108d5506b83a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/89156f1867314be89e5108d5506b83a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89156f1867314be89e5108d5506b83a3"}]}] Jun 30 18:36:14.571680 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant: tempest-ServerRescueNegativeTestJSON-785753659 Jun 30 18:36:14.571680 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Id: 89156f1867314be89e5108d5506b83a3 Jun 30 18:36:14.571680 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-785753659 Jun 30 18:36:14.571680 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User: tempest-ServerRescueNegativeTestJSON-785753659-project Jun 30 18:36:14.571680 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Id: default Jun 30 18:36:14.571680 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Name: Default Jun 30 18:36:14.571680 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Id: c66efdb1cc27467d85831617590c8b28 Jun 30 18:36:14.571680 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Name: tempest-ServerRescueNegativeTestJSON-785753659-project Jun 30 18:36:14.571680 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: method: > Jun 30 18:36:14.571680 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: exception: Instance 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd could not be found. Jun 30 18:36:14.571680 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: action_args: {'id': '5df6e0a7-4daa-4bb9-943a-69462fa6bcfd'} Jun 30 18:36:14.572555 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:36:14.572555 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:36:14.572555 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:36:14.572555 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:36:14.572555 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:36:14.572555 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:36:14.572555 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:36:14.572555 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:36:14.572555 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:36:14.572555 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:36:14.572555 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd could not be found. Jun 30 18:36:14.572555 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:36:14.572555 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:36:14.572555 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:36:14.572555 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:36:14.572555 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:36:14.572555 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:36:14.572555 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:36:14.572555 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:36:14.572555 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:36:14.574084 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:36:14.574084 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:36:14.574084 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:36:14.574084 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:36:14.574084 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:36:14.574084 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:36:14.574084 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:36:14.574084 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd could not be found. Jun 30 18:36:14.574084 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:36:14.574084 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:36:14.574084 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:36:14.574084 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:36:14.574084 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:36:14.574084 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:36:14.574084 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:36:14.574084 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:36:14.574084 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd could not be found. Jun 30 18:36:14.574084 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:36:14.575463 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-c54f429f-ad27-4cfe-9d6f-0da5a10ca080 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Returning 404 to user: Instance 5df6e0a7-4daa-4bb9-943a-69462fa6bcfd could not be found. {{(pid=117941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:36:14.575463 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-c54f429f-ad27-4cfe-9d6f-0da5a10ca080 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd" status: 404 len: 111 microversion: 2.1 time: 0.031427 Jun 30 18:36:14.575463 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 412/819] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:36:14 2022] GET /compute/v2.1/servers/5df6e0a7-4daa-4bb9-943a-69462fa6bcfd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:36:14.581559 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-623ea866-e025-4a7a-b226-faa3114b3736 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:36:14.582258 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-623ea866-e025-4a7a-b226-faa3114b3736 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: d6c61f3b-a138-4d3c-971d-8f25d3124178] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:36:14.589338 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-623ea866-e025-4a7a-b226-faa3114b3736 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:14.589813 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-623ea866-e025-4a7a-b226-faa3114b3736 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:14.590559 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-623ea866-e025-4a7a-b226-faa3114b3736 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:14.590985 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-623ea866-e025-4a7a-b226-faa3114b3736 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:14.616166 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-623ea866-e025-4a7a-b226-faa3114b3736 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: d6c61f3b-a138-4d3c-971d-8f25d3124178] Going to try to terminate instance {{(pid=117940) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 18:36:14.691883 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-623ea866-e025-4a7a-b226-faa3114b3736 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178" status: 204 len: 0 microversion: 2.1 time: 0.114325 Jun 30 18:36:14.692678 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 408/820] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 30 18:36:14 2022] DELETE /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 18:36:14.701197 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-78dde29f-ed53-484d-acf6-d51a38cede8a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:36:14.701835 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-78dde29f-ed53-484d-acf6-d51a38cede8a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: d6c61f3b-a138-4d3c-971d-8f25d3124178] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:36:14.708111 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-78dde29f-ed53-484d-acf6-d51a38cede8a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:14.709055 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-78dde29f-ed53-484d-acf6-d51a38cede8a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:14.710603 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-78dde29f-ed53-484d-acf6-d51a38cede8a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:14.711036 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-78dde29f-ed53-484d-acf6-d51a38cede8a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:14.840441 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-78dde29f-ed53-484d-acf6-d51a38cede8a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:36:14.847745 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-78dde29f-ed53-484d-acf6-d51a38cede8a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178" status: 200 len: 1521 microversion: 2.1 time: 0.150323 Jun 30 18:36:14.848337 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 413/821] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:36:14 2022] GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:36:15.866902 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-17a5daf9-5f1c-4c40-9a0e-9df1192d955a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:36:15.867664 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-17a5daf9-5f1c-4c40-9a0e-9df1192d955a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: d6c61f3b-a138-4d3c-971d-8f25d3124178] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:36:15.874055 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-17a5daf9-5f1c-4c40-9a0e-9df1192d955a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:15.874504 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-17a5daf9-5f1c-4c40-9a0e-9df1192d955a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:15.875302 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-17a5daf9-5f1c-4c40-9a0e-9df1192d955a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:15.875739 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-17a5daf9-5f1c-4c40-9a0e-9df1192d955a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:16.086519 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-17a5daf9-5f1c-4c40-9a0e-9df1192d955a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66efdb1cc27467d85831617590c8b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89156f1867314be89e5108d5506b83a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:36:16.093935 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-17a5daf9-5f1c-4c40-9a0e-9df1192d955a tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178" status: 200 len: 1521 microversion: 2.1 time: 0.232000 Jun 30 18:36:16.094517 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 409/822] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:36:15 2022] GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:36:16.207539 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-0d89c1bf-a83c-4f8b-b45c-410ebcc6b8a1 req-4d48f157-9192-4739-ba40-9fca1362ae81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6c61f3b-a138-4d3c-971d-8f25d3124178", "name": "network-vif-deleted", "tag": "8c7fc4bb-044c-4951-ae37-7f1aab689075"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:36:16.217855 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-0d89c1bf-a83c-4f8b-b45c-410ebcc6b8a1 req-4d48f157-9192-4739-ba40-9fca1362ae81 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:16.218520 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-0d89c1bf-a83c-4f8b-b45c-410ebcc6b8a1 req-4d48f157-9192-4739-ba40-9fca1362ae81 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:16.231822 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.compute.server_external_events [req-0d89c1bf-a83c-4f8b-b45c-410ebcc6b8a1 req-4d48f157-9192-4739-ba40-9fca1362ae81 service nova] Creating event network-vif-deleted:8c7fc4bb-044c-4951-ae37-7f1aab689075 for instance d6c61f3b-a138-4d3c-971d-8f25d3124178 on hv-cinder-80378 Jun 30 18:36:16.236657 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-0d89c1bf-a83c-4f8b-b45c-410ebcc6b8a1 req-4d48f157-9192-4739-ba40-9fca1362ae81 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033446 Jun 30 18:36:16.237250 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 414/823] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:36:17.111602 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-03fd6131-c4db-42b5-9221-c85c620e1fa4 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:36:17.112200 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-03fd6131-c4db-42b5-9221-c85c620e1fa4 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] [instance: d6c61f3b-a138-4d3c-971d-8f25d3124178] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:36:17.119067 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-03fd6131-c4db-42b5-9221-c85c620e1fa4 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:17.119450 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-03fd6131-c4db-42b5-9221-c85c620e1fa4 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:17.120193 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-03fd6131-c4db-42b5-9221-c85c620e1fa4 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:17.120628 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-03fd6131-c4db-42b5-9221-c85c620e1fa4 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:17.134257 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.wsgi [None req-03fd6131-c4db-42b5-9221-c85c620e1fa4 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] HTTP exception thrown: Instance d6c61f3b-a138-4d3c-971d-8f25d3124178 could not be found. Jun 30 18:36:17.135849 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-03fd6131-c4db-42b5-9221-c85c620e1fa4 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Request method failure captured: Jun 30 18:36:17.135849 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: request: GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178 HTTP/1.1 Jun 30 18:36:17.135849 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept: application/json Jun 30 18:36:17.135849 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept-Encoding: identity Jun 30 18:36:17.135849 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Connection: close Jun 30 18:36:17.135849 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Length: 0 Jun 30 18:36:17.135849 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Type: application/json Jun 30 18:36:17.135849 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Host: 10.222.0.33 Jun 30 18:36:17.135849 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Openstack-System-Scope: None Jun 30 18:36:17.135849 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: User-Agent: python-urllib3/1.26.9 Jun 30 18:36:17.135849 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Auth-Token: gAAAAABivetPoBJVuK1_waLHBdUgEdOXaEr_7pepJLshTowu0y0zEtLsiCOVgrIZcKArCDbekbtcpzpEH-S3F9_gKy-yucVrKZ3vxF5Hhm7_TRqirclJF8mG1hvbjhTpmtvTiqYsOVgnx89AOW01E7ENmFhWdbFyZjBHC046c8-hCFkVolZmamg Jun 30 18:36:17.135849 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Id: None Jun 30 18:36:17.135849 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Name: None Jun 30 18:36:17.135849 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Identity-Status: Confirmed Jun 30 18:36:17.135849 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Is-Admin-Project: True Jun 30 18:36:17.135849 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Id: default Jun 30 18:36:17.135849 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Name: Default Jun 30 18:36:17.135849 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Id: 89156f1867314be89e5108d5506b83a3 Jun 30 18:36:17.135849 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-785753659 Jun 30 18:36:17.135849 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Role: reader,member Jun 30 18:36:17.135849 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Roles: reader,member Jun 30 18:36:17.137409 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89156f1867314be89e5108d5506b83a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_89156f1867314be89e5108d5506b83a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/89156f1867314be89e5108d5506b83a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89156f1867314be89e5108d5506b83a3"}]}] Jun 30 18:36:17.137409 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant: tempest-ServerRescueNegativeTestJSON-785753659 Jun 30 18:36:17.137409 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Id: 89156f1867314be89e5108d5506b83a3 Jun 30 18:36:17.137409 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-785753659 Jun 30 18:36:17.137409 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User: tempest-ServerRescueNegativeTestJSON-785753659-project Jun 30 18:36:17.137409 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Id: default Jun 30 18:36:17.137409 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Name: Default Jun 30 18:36:17.137409 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Id: c66efdb1cc27467d85831617590c8b28 Jun 30 18:36:17.137409 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Name: tempest-ServerRescueNegativeTestJSON-785753659-project Jun 30 18:36:17.137409 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: method: > Jun 30 18:36:17.137409 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: exception: Instance d6c61f3b-a138-4d3c-971d-8f25d3124178 could not be found. Jun 30 18:36:17.137409 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: action_args: {'id': 'd6c61f3b-a138-4d3c-971d-8f25d3124178'} Jun 30 18:36:17.138337 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:36:17.138337 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:36:17.138337 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:36:17.138337 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:36:17.138337 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:36:17.138337 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:36:17.138337 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:36:17.138337 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:36:17.138337 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:36:17.138337 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:36:17.138337 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6c61f3b-a138-4d3c-971d-8f25d3124178 could not be found. Jun 30 18:36:17.138337 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:36:17.138337 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:36:17.138337 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:36:17.138337 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:36:17.138337 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:36:17.138337 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:36:17.138337 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:36:17.138337 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:36:17.138337 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:36:17.139802 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:36:17.139802 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:36:17.139802 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:36:17.139802 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:36:17.139802 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:36:17.139802 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:36:17.139802 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:36:17.139802 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6c61f3b-a138-4d3c-971d-8f25d3124178 could not be found. Jun 30 18:36:17.139802 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:36:17.139802 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:36:17.139802 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:36:17.139802 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:36:17.139802 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:36:17.139802 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:36:17.139802 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:36:17.139802 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:36:17.139802 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6c61f3b-a138-4d3c-971d-8f25d3124178 could not be found. Jun 30 18:36:17.139802 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:36:17.141156 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-03fd6131-c4db-42b5-9221-c85c620e1fa4 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] Returning 404 to user: Instance d6c61f3b-a138-4d3c-971d-8f25d3124178 could not be found. {{(pid=117940) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:36:17.141156 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-03fd6131-c4db-42b5-9221-c85c620e1fa4 tempest-ServerRescueNegativeTestJSON-785753659 tempest-ServerRescueNegativeTestJSON-785753659-project] 10.222.0.33 "GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178" status: 404 len: 111 microversion: 2.1 time: 0.029436 Jun 30 18:36:17.141156 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 410/824] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:36:17 2022] GET /compute/v2.1/servers/d6c61f3b-a138-4d3c-971d-8f25d3124178 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:36:52.025037 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-8370e1cd-392f-4d40-8815-87e079af1f47 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:36:52.026072 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-8370e1cd-392f-4d40-8815-87e079af1f47 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:36:52.028416 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=2 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:36:52.029292 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:36:52.035665 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8370e1cd-392f-4d40-8815-87e079af1f47 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:52.036153 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8370e1cd-392f-4d40-8815-87e079af1f47 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:52.036912 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8370e1cd-392f-4d40-8815-87e079af1f47 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:52.037335 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8370e1cd-392f-4d40-8815-87e079af1f47 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:52.067809 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-8370e1cd-392f-4d40-8815-87e079af1f47 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047049 Jun 30 18:36:52.068366 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 415/825] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 30 18:36:52 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 18:36:52.126665 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-f22fbec1-a2fe-402f-b24f-8f2bf616a9bb tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:36:52.127159 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-f22fbec1-a2fe-402f-b24f-8f2bf616a9bb tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:36:52.129423 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:36:52.130117 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell1:SELECT=63,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:36:52.136030 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f22fbec1-a2fe-402f-b24f-8f2bf616a9bb tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:52.136481 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f22fbec1-a2fe-402f-b24f-8f2bf616a9bb tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:52.137238 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f22fbec1-a2fe-402f-b24f-8f2bf616a9bb tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:52.137702 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f22fbec1-a2fe-402f-b24f-8f2bf616a9bb tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:52.168233 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-f22fbec1-a2fe-402f-b24f-8f2bf616a9bb tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Going to try to terminate instance {{(pid=117940) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 18:36:52.247405 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-f22fbec1-a2fe-402f-b24f-8f2bf616a9bb tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 204 len: 0 microversion: 2.1 time: 0.124712 Jun 30 18:36:52.247914 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 411/826] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 30 18:36:52 2022] DELETE /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 18:36:52.257267 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-1d02e0c2-413b-4a26-bc28-3aa4ed0aa4d8 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:36:52.258021 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-1d02e0c2-413b-4a26-bc28-3aa4ed0aa4d8 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:36:52.263904 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1d02e0c2-413b-4a26-bc28-3aa4ed0aa4d8 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:52.264344 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1d02e0c2-413b-4a26-bc28-3aa4ed0aa4d8 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:52.265085 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1d02e0c2-413b-4a26-bc28-3aa4ed0aa4d8 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:52.265506 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1d02e0c2-413b-4a26-bc28-3aa4ed0aa4d8 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:52.398416 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-1d02e0c2-413b-4a26-bc28-3aa4ed0aa4d8 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:36:52.405710 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-1d02e0c2-413b-4a26-bc28-3aa4ed0aa4d8 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1673 microversion: 2.1 time: 0.153013 Jun 30 18:36:52.407936 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 416/827] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:36:52 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:36:53.200552 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:36:53.201203 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Thu Jun 30 18:36:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:36:53.423980 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-39f7d07c-e549-4d3f-80a2-430d68cc03da tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:36:53.424675 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-39f7d07c-e549-4d3f-80a2-430d68cc03da tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:36:53.431370 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-39f7d07c-e549-4d3f-80a2-430d68cc03da tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:53.431820 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-39f7d07c-e549-4d3f-80a2-430d68cc03da tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:53.432577 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-39f7d07c-e549-4d3f-80a2-430d68cc03da tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:53.433019 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-39f7d07c-e549-4d3f-80a2-430d68cc03da tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:53.580147 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-39f7d07c-e549-4d3f-80a2-430d68cc03da tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:36:53.589920 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-39f7d07c-e549-4d3f-80a2-430d68cc03da tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1673 microversion: 2.1 time: 0.170107 Jun 30 18:36:53.592403 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 412/828] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:36:53 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1673 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:36:54.608397 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-95a934d3-46ba-41b5-a3f8-4af123935fff tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:36:54.608976 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-95a934d3-46ba-41b5-a3f8-4af123935fff tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:36:54.616081 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-95a934d3-46ba-41b5-a3f8-4af123935fff tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:54.616532 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-95a934d3-46ba-41b5-a3f8-4af123935fff tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:54.617306 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-95a934d3-46ba-41b5-a3f8-4af123935fff tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:54.617951 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-95a934d3-46ba-41b5-a3f8-4af123935fff tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:54.949673 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-95a934d3-46ba-41b5-a3f8-4af123935fff tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:36:54.958004 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-95a934d3-46ba-41b5-a3f8-4af123935fff tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1605 microversion: 2.1 time: 0.353976 Jun 30 18:36:54.967930 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 417/829] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:36:54 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1605 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:36:55.175610 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [req-1ae53940-024a-4f41-b4aa-c9f8252764f5 req-14d397a3-2701-433d-b582-8bb5a8015c24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e559236-fa0a-4378-b21f-e5f5e669751d", "name": "network-vif-deleted", "tag": "2523b467-c01d-4854-a427-8bf6153c35b2"}]} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:36:55.185614 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-1ae53940-024a-4f41-b4aa-c9f8252764f5 req-14d397a3-2701-433d-b582-8bb5a8015c24 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:55.186000 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-1ae53940-024a-4f41-b4aa-c9f8252764f5 req-14d397a3-2701-433d-b582-8bb5a8015c24 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:55.200334 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.compute.server_external_events [req-1ae53940-024a-4f41-b4aa-c9f8252764f5 req-14d397a3-2701-433d-b582-8bb5a8015c24 service nova] Creating event network-vif-deleted:2523b467-c01d-4854-a427-8bf6153c35b2 for instance 2e559236-fa0a-4378-b21f-e5f5e669751d on hv-cinder-80378 Jun 30 18:36:55.209299 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [req-1ae53940-024a-4f41-b4aa-c9f8252764f5 req-14d397a3-2701-433d-b582-8bb5a8015c24 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037967 Jun 30 18:36:55.210716 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 413/830] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:36:55.975839 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-0dffe4c4-39b4-4789-be0d-04240b0e3abb tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:36:55.976439 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-0dffe4c4-39b4-4789-be0d-04240b0e3abb tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:36:55.983266 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0dffe4c4-39b4-4789-be0d-04240b0e3abb tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:55.983704 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0dffe4c4-39b4-4789-be0d-04240b0e3abb tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:55.984558 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0dffe4c4-39b4-4789-be0d-04240b0e3abb tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:55.984938 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0dffe4c4-39b4-4789-be0d-04240b0e3abb tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:56.020415 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0dffe4c4-39b4-4789-be0d-04240b0e3abb tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:56.021139 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0dffe4c4-39b4-4789-be0d-04240b0e3abb tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:56.021813 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.objects.instance [None req-0dffe4c4-39b4-4789-be0d-04240b0e3abb tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lazy-loading 'fault' on Instance uuid 2e559236-fa0a-4378-b21f-e5f5e669751d {{(pid=117941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 18:36:56.074210 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-0dffe4c4-39b4-4789-be0d-04240b0e3abb tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:36:56.083751 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-0dffe4c4-39b4-4789-be0d-04240b0e3abb tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 200 len: 1326 microversion: 2.1 time: 0.111680 Jun 30 18:36:56.084375 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 418/831] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:36:55 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 1326 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:36:57.101633 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-6b2695bb-55d2-4a55-bf47-aff5809c7a44 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:36:57.102331 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-6b2695bb-55d2-4a55-bf47-aff5809c7a44 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:36:57.108475 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6b2695bb-55d2-4a55-bf47-aff5809c7a44 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:57.108931 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6b2695bb-55d2-4a55-bf47-aff5809c7a44 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:57.109719 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6b2695bb-55d2-4a55-bf47-aff5809c7a44 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:57.110157 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6b2695bb-55d2-4a55-bf47-aff5809c7a44 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:57.123148 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.wsgi [None req-6b2695bb-55d2-4a55-bf47-aff5809c7a44 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] HTTP exception thrown: Instance 2e559236-fa0a-4378-b21f-e5f5e669751d could not be found. Jun 30 18:36:57.124723 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-6b2695bb-55d2-4a55-bf47-aff5809c7a44 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Request method failure captured: Jun 30 18:36:57.124723 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: request: GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d HTTP/1.1 Jun 30 18:36:57.124723 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept: application/json Jun 30 18:36:57.124723 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept-Encoding: identity Jun 30 18:36:57.124723 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Connection: close Jun 30 18:36:57.124723 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Length: 0 Jun 30 18:36:57.124723 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Type: application/json Jun 30 18:36:57.124723 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Host: 10.222.0.33 Jun 30 18:36:57.124723 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Openstack-System-Scope: None Jun 30 18:36:57.124723 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: User-Agent: python-urllib3/1.26.9 Jun 30 18:36:57.124723 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Auth-Token: gAAAAABiveuuH82i-YLb0OxxVVWp1NwpPb1owgHQi2P6swgIWmFgaFrviBufDQYdbB4_ZJTyaS1yL1Yy1WvXsovGI8Vb1kizrvRZjFWwQUkCVIL9AVVBKtPi4Sls33Errw5DIRH3Ni4zFX1q97gGxYDGT_fbMT-kNhddd0rI6myqLPYdXJvya4U Jun 30 18:36:57.124723 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Id: None Jun 30 18:36:57.124723 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Name: None Jun 30 18:36:57.124723 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Identity-Status: Confirmed Jun 30 18:36:57.124723 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Is-Admin-Project: True Jun 30 18:36:57.124723 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Id: default Jun 30 18:36:57.124723 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Name: Default Jun 30 18:36:57.124723 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Id: 76384f04296b43b69e675de14cf1a55a Jun 30 18:36:57.124723 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Name: tempest-AttachVolumeTestJSON-1612416413 Jun 30 18:36:57.124723 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Role: reader,member Jun 30 18:36:57.124723 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Roles: reader,member Jun 30 18:36:57.126771 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/76384f04296b43b69e675de14cf1a55a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_76384f04296b43b69e675de14cf1a55a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/76384f04296b43b69e675de14cf1a55a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/76384f04296b43b69e675de14cf1a55a"}]}] Jun 30 18:36:57.126771 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant: tempest-AttachVolumeTestJSON-1612416413 Jun 30 18:36:57.126771 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Id: 76384f04296b43b69e675de14cf1a55a Jun 30 18:36:57.126771 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1612416413 Jun 30 18:36:57.126771 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User: tempest-AttachVolumeTestJSON-1612416413-project Jun 30 18:36:57.126771 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Id: default Jun 30 18:36:57.126771 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Name: Default Jun 30 18:36:57.126771 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Id: 6ac4fc6cab4f47ea910ffdbed0a8e5b8 Jun 30 18:36:57.126771 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Name: tempest-AttachVolumeTestJSON-1612416413-project Jun 30 18:36:57.126771 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: method: > Jun 30 18:36:57.126771 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: exception: Instance 2e559236-fa0a-4378-b21f-e5f5e669751d could not be found. Jun 30 18:36:57.126771 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: action_args: {'id': '2e559236-fa0a-4378-b21f-e5f5e669751d'} Jun 30 18:36:57.127658 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:36:57.127658 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:36:57.127658 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:36:57.127658 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:36:57.127658 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:36:57.127658 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:36:57.127658 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:36:57.127658 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:36:57.127658 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:36:57.127658 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:36:57.127658 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e559236-fa0a-4378-b21f-e5f5e669751d could not be found. Jun 30 18:36:57.127658 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:36:57.127658 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:36:57.127658 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:36:57.127658 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:36:57.127658 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:36:57.127658 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:36:57.127658 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:36:57.127658 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:36:57.127658 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:36:57.129302 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:36:57.129302 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:36:57.129302 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:36:57.129302 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:36:57.129302 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:36:57.129302 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:36:57.129302 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:36:57.129302 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e559236-fa0a-4378-b21f-e5f5e669751d could not be found. Jun 30 18:36:57.129302 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:36:57.129302 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:36:57.129302 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:36:57.129302 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:36:57.129302 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:36:57.129302 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:36:57.129302 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:36:57.129302 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:36:57.129302 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e559236-fa0a-4378-b21f-e5f5e669751d could not be found. Jun 30 18:36:57.129302 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:36:57.130941 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-6b2695bb-55d2-4a55-bf47-aff5809c7a44 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Returning 404 to user: Instance 2e559236-fa0a-4378-b21f-e5f5e669751d could not be found. {{(pid=117940) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:36:57.130941 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-6b2695bb-55d2-4a55-bf47-aff5809c7a44 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 404 len: 111 microversion: 2.1 time: 0.029840 Jun 30 18:36:57.130941 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 414/832] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:36:57 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:36:57.135506 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-9002e556-1e34-4709-afd9-af7c514581b5 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '.version_select at 0x7f18094971f0>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:36:57.154501 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-9002e556-1e34-4709-afd9-af7c514581b5 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-725038416" status: 202 len: 0 microversion: 2.1 time: 0.022651 Jun 30 18:36:57.155179 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 419/833] 10.222.0.33 () {58 vars in 1217 bytes} [Thu Jun 30 18:36:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-725038416 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 18:36:57.791926 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-d0f7caca-cfa3-410d-bb5a-3ba297e08cd8 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Action: 'create', calling method: .version_select at 0x7f1804b3e550>, body: {"keypair": {"name": "tempest-keypair-1198799414", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIeLZuuaVgOMyVoeg9X6z6Z0SQ8q3x9bjvxe7INQp6+YFhAReXnIhRHjA0eaKC58mzAPY/N46HS9PFqVuPqN1Iv1ctMJLfL7SJrqHsQuOiwbmhetSst5LhKnf4z1VIVTMA=="}} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:36:57.807884 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.quota [None req-d0f7caca-cfa3-410d-bb5a-3ba297e08cd8 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Getting quotas for project 76384f04296b43b69e675de14cf1a55a. Resources: {'key_pairs'} {{(pid=117940) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 18:36:57.811676 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.quota [None req-d0f7caca-cfa3-410d-bb5a-3ba297e08cd8 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Getting quotas for user 6ac4fc6cab4f47ea910ffdbed0a8e5b8 and project 76384f04296b43b69e675de14cf1a55a. Resources: {'key_pairs'} {{(pid=117940) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 18:36:57.834240 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-d0f7caca-cfa3-410d-bb5a-3ba297e08cd8 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046534 Jun 30 18:36:57.834831 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 415/834] 10.222.0.33 () {60 vars in 1158 bytes} [Thu Jun 30 18:36:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:36:59.169941 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-4a0cfd0a-b336-4521-89a5-772af5501c1d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1749828440", "imageRef": "636d6d52-5033-47e1-bf75-0b4fc50c0bb0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fe4fb437-870b-4a13-920f-45455dbbc61c"}], "security_groups": [{"name": "tempest-securitygroup--1004977003"}], "key_name": "tempest-keypair-1198799414", "user_data": "}} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:36:59.270228 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.network.neutron [None req-4a0cfd0a-b336-4521-89a5-772af5501c1d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] validate_networks() for [('fe4fb437-870b-4a13-920f-45455dbbc61c', None, None, None, None, None)] {{(pid=117941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 18:36:59.740474 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.virt.hardware [None req-4a0cfd0a-b336-4521-89a5-772af5501c1d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Flavor limits 0:0:0 {{(pid=117941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 18:36:59.740892 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.virt.hardware [None req-4a0cfd0a-b336-4521-89a5-772af5501c1d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Image limits 0:0:0 {{(pid=117941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 18:36:59.741362 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.virt.hardware [None req-4a0cfd0a-b336-4521-89a5-772af5501c1d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Flavor pref 0:0:0 {{(pid=117941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 18:36:59.741807 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.virt.hardware [None req-4a0cfd0a-b336-4521-89a5-772af5501c1d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Image pref 0:0:0 {{(pid=117941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 18:36:59.742243 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.virt.hardware [None req-4a0cfd0a-b336-4521-89a5-772af5501c1d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 18:36:59.750875 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-4a0cfd0a-b336-4521-89a5-772af5501c1d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:59.751324 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-4a0cfd0a-b336-4521-89a5-772af5501c1d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:59.752117 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-4a0cfd0a-b336-4521-89a5-772af5501c1d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:36:59.752546 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-4a0cfd0a-b336-4521-89a5-772af5501c1d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:36:59.769137 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.quota [None req-4a0cfd0a-b336-4521-89a5-772af5501c1d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Getting quotas for project 76384f04296b43b69e675de14cf1a55a. Resources: {'ram', 'instances', 'cores'} {{(pid=117941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 18:36:59.773073 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.quota [None req-4a0cfd0a-b336-4521-89a5-772af5501c1d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Getting quotas for user 6ac4fc6cab4f47ea910ffdbed0a8e5b8 and project 76384f04296b43b69e675de14cf1a55a. Resources: {'ram', 'instances', 'cores'} {{(pid=117941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 18:36:59.784406 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-4a0cfd0a-b336-4521-89a5-772af5501c1d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Going to run 1 instances... {{(pid=117941) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 18:36:59.786650 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-4a0cfd0a-b336-4521-89a5-772af5501c1d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: a70367a4-54b1-405e-9b10-5356217349d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='636d6d52-5033-47e1-bf75-0b4fc50c0bb0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 18:36:59.833255 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-4a0cfd0a-b336-4521-89a5-772af5501c1d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.668082 Jun 30 18:36:59.838690 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 420/835] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 30 18:36:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 18:36:59.845763 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-fcca2065-c171-4d77-9ff5-2e15a915d734 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:36:59.846395 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-fcca2065-c171-4d77-9ff5-2e15a915d734 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: a70367a4-54b1-405e-9b10-5356217349d4] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:36:59.908611 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-fcca2065-c171-4d77-9ff5-2e15a915d734 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:36:59.919715 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-fcca2065-c171-4d77-9ff5-2e15a915d734 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4" status: 200 len: 1238 microversion: 2.1 time: 0.079463 Jun 30 18:36:59.920437 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 416/836] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:36:59 2022] GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4 => generated 1238 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:37:00.936673 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-76314f1c-2111-4e2a-a593-b03f43d0a718 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:00.937837 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-76314f1c-2111-4e2a-a593-b03f43d0a718 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: a70367a4-54b1-405e-9b10-5356217349d4] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:00.945129 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-76314f1c-2111-4e2a-a593-b03f43d0a718 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:00.946046 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-76314f1c-2111-4e2a-a593-b03f43d0a718 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:00.946955 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-76314f1c-2111-4e2a-a593-b03f43d0a718 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:00.947540 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-76314f1c-2111-4e2a-a593-b03f43d0a718 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:01.019238 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-76314f1c-2111-4e2a-a593-b03f43d0a718 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:01.026645 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-76314f1c-2111-4e2a-a593-b03f43d0a718 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4" status: 200 len: 1296 microversion: 2.1 time: 0.094448 Jun 30 18:37:01.027211 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 421/837] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:37:00 2022] GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4 => generated 1296 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:37:02.044626 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-82d65e68-015e-4ff0-944d-c0f6be7cb20b tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:02.045225 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-82d65e68-015e-4ff0-944d-c0f6be7cb20b tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: a70367a4-54b1-405e-9b10-5356217349d4] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:02.052926 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-82d65e68-015e-4ff0-944d-c0f6be7cb20b tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:02.053369 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-82d65e68-015e-4ff0-944d-c0f6be7cb20b tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:02.054159 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-82d65e68-015e-4ff0-944d-c0f6be7cb20b tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:02.054589 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-82d65e68-015e-4ff0-944d-c0f6be7cb20b tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:02.268095 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-82d65e68-015e-4ff0-944d-c0f6be7cb20b tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:02.275474 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-82d65e68-015e-4ff0-944d-c0f6be7cb20b tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4" status: 200 len: 1364 microversion: 2.1 time: 0.235559 Jun 30 18:37:02.276334 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 417/838] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:37:02 2022] GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4 => generated 1364 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:37:02.384761 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-488679b6-147f-4aae-9e35-118a20f05151 req-a430b31a-8a38-4ed3-8c2d-37e594f2f972 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a70367a4-54b1-405e-9b10-5356217349d4", "tag": "1664f24e-d445-414c-9bb0-934bafacdaa9"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:37:02.404192 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-488679b6-147f-4aae-9e35-118a20f05151 req-a430b31a-8a38-4ed3-8c2d-37e594f2f972 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:02.404872 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-488679b6-147f-4aae-9e35-118a20f05151 req-a430b31a-8a38-4ed3-8c2d-37e594f2f972 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:02.418898 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.compute.server_external_events [req-488679b6-147f-4aae-9e35-118a20f05151 req-a430b31a-8a38-4ed3-8c2d-37e594f2f972 service nova] Creating event network-changed:1664f24e-d445-414c-9bb0-934bafacdaa9 for instance a70367a4-54b1-405e-9b10-5356217349d4 on hv-cinder-80378 Jun 30 18:37:02.425918 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-488679b6-147f-4aae-9e35-118a20f05151 req-a430b31a-8a38-4ed3-8c2d-37e594f2f972 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046917 Jun 30 18:37:02.426523 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 422/839] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:37:03.292477 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-6fb3d209-70f4-46cd-b522-8a981b896e53 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:03.293075 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-6fb3d209-70f4-46cd-b522-8a981b896e53 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: a70367a4-54b1-405e-9b10-5356217349d4] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:03.299758 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6fb3d209-70f4-46cd-b522-8a981b896e53 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:03.300202 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6fb3d209-70f4-46cd-b522-8a981b896e53 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:03.300961 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6fb3d209-70f4-46cd-b522-8a981b896e53 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:03.301393 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6fb3d209-70f4-46cd-b522-8a981b896e53 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:03.429672 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-6fb3d209-70f4-46cd-b522-8a981b896e53 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:03.436991 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-6fb3d209-70f4-46cd-b522-8a981b896e53 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4" status: 200 len: 1364 microversion: 2.1 time: 0.148375 Jun 30 18:37:03.437556 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 418/840] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:37:03 2022] GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:37:04.453984 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-09e7af6c-6119-4399-bab3-078b753ccd99 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:04.454670 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-09e7af6c-6119-4399-bab3-078b753ccd99 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: a70367a4-54b1-405e-9b10-5356217349d4] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:04.461385 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-09e7af6c-6119-4399-bab3-078b753ccd99 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:04.461852 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-09e7af6c-6119-4399-bab3-078b753ccd99 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:04.462594 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-09e7af6c-6119-4399-bab3-078b753ccd99 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:04.463273 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-09e7af6c-6119-4399-bab3-078b753ccd99 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:04.592197 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-09e7af6c-6119-4399-bab3-078b753ccd99 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:04.600330 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-09e7af6c-6119-4399-bab3-078b753ccd99 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4" status: 200 len: 1364 microversion: 2.1 time: 0.150537 Jun 30 18:37:04.600894 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 423/841] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:37:04 2022] GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:37:04.744740 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-c7738397-e677-42bb-95a5-ec4f424ec22f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:04.745266 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-c7738397-e677-42bb-95a5-ec4f424ec22f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:04.751690 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c7738397-e677-42bb-95a5-ec4f424ec22f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:04.752135 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c7738397-e677-42bb-95a5-ec4f424ec22f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:04.752881 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c7738397-e677-42bb-95a5-ec4f424ec22f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:04.753306 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c7738397-e677-42bb-95a5-ec4f424ec22f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:04.775226 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-c7738397-e677-42bb-95a5-ec4f424ec22f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3/ips" status: 200 len: 152 microversion: 2.20 time: 0.034416 Jun 30 18:37:04.775774 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 419/842] 10.222.0.33 () {60 vars in 1288 bytes} [Thu Jun 30 18:37:04 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3/ips => generated 152 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 18:37:05.452699 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-aa0343e8-a326-46ab-9208-3a08e097e499 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:05.453194 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-aa0343e8-a326-46ab-9208-3a08e097e499 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: 44d46d26-912d-40fd-8bd6-5b576e81cf20] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:05.460438 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-aa0343e8-a326-46ab-9208-3a08e097e499 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:05.461011 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-aa0343e8-a326-46ab-9208-3a08e097e499 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:05.461699 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-aa0343e8-a326-46ab-9208-3a08e097e499 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:05.462133 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-aa0343e8-a326-46ab-9208-3a08e097e499 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:05.488764 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-aa0343e8-a326-46ab-9208-3a08e097e499 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: 44d46d26-912d-40fd-8bd6-5b576e81cf20] Going to try to terminate instance {{(pid=117941) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 18:37:05.565111 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-aa0343e8-a326-46ab-9208-3a08e097e499 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "DELETE /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20" status: 204 len: 0 microversion: 2.1 time: 0.115970 Jun 30 18:37:05.565714 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 424/843] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 30 18:37:05 2022] DELETE /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 18:37:05.573735 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-f2382614-a69e-4bb8-9912-606ac991d8cd tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:05.574355 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-f2382614-a69e-4bb8-9912-606ac991d8cd tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: 44d46d26-912d-40fd-8bd6-5b576e81cf20] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:05.581335 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f2382614-a69e-4bb8-9912-606ac991d8cd tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:05.581816 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f2382614-a69e-4bb8-9912-606ac991d8cd tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:05.582589 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f2382614-a69e-4bb8-9912-606ac991d8cd tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:05.583012 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f2382614-a69e-4bb8-9912-606ac991d8cd tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:05.618186 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-16538d16-d78d-4151-988b-69dc6ca26036 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:05.619045 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-16538d16-d78d-4151-988b-69dc6ca26036 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: a70367a4-54b1-405e-9b10-5356217349d4] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:05.625052 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-16538d16-d78d-4151-988b-69dc6ca26036 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:05.625491 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-16538d16-d78d-4151-988b-69dc6ca26036 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:05.627410 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-16538d16-d78d-4151-988b-69dc6ca26036 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:05.627845 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-16538d16-d78d-4151-988b-69dc6ca26036 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:05.764253 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-f2382614-a69e-4bb8-9912-606ac991d8cd tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:05.772545 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-f2382614-a69e-4bb8-9912-606ac991d8cd tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20" status: 200 len: 1577 microversion: 2.1 time: 0.202592 Jun 30 18:37:05.773121 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 420/844] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:37:05 2022] GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20 => generated 1577 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:37:05.791227 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-16538d16-d78d-4151-988b-69dc6ca26036 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:05.799627 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-16538d16-d78d-4151-988b-69dc6ca26036 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4" status: 200 len: 1364 microversion: 2.1 time: 0.186066 Jun 30 18:37:05.800185 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 425/845] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:37:05 2022] GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4 => generated 1364 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:37:06.790706 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-2dc92fd8-bf18-447a-85df-db851d214977 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:06.791231 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-2dc92fd8-bf18-447a-85df-db851d214977 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: 44d46d26-912d-40fd-8bd6-5b576e81cf20] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:06.799244 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-2dc92fd8-bf18-447a-85df-db851d214977 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:06.799804 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-2dc92fd8-bf18-447a-85df-db851d214977 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:06.800712 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-2dc92fd8-bf18-447a-85df-db851d214977 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:06.801158 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-2dc92fd8-bf18-447a-85df-db851d214977 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:06.817406 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-59924aef-ab3c-4b10-add1-397f97f7a59c tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:06.818035 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-59924aef-ab3c-4b10-add1-397f97f7a59c tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: a70367a4-54b1-405e-9b10-5356217349d4] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:06.824395 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-59924aef-ab3c-4b10-add1-397f97f7a59c tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:06.824835 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-59924aef-ab3c-4b10-add1-397f97f7a59c tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:06.825600 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-59924aef-ab3c-4b10-add1-397f97f7a59c tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:06.826035 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-59924aef-ab3c-4b10-add1-397f97f7a59c tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:07.009495 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-2dc92fd8-bf18-447a-85df-db851d214977 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:07.013710 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-59924aef-ab3c-4b10-add1-397f97f7a59c tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:07.017882 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-2dc92fd8-bf18-447a-85df-db851d214977 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20" status: 200 len: 1577 microversion: 2.1 time: 0.231164 Jun 30 18:37:07.018600 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 421/846] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:37:06 2022] GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20 => generated 1577 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:37:07.021185 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-59924aef-ab3c-4b10-add1-397f97f7a59c tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4" status: 200 len: 1364 microversion: 2.1 time: 0.208744 Jun 30 18:37:07.031448 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 426/847] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:37:06 2022] GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4 => generated 1364 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:37:07.651269 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-f29b637b-bb0c-4b02-8334-924e71f20b9e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:37:07.651801 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-f29b637b-bb0c-4b02-8334-924e71f20b9e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:07.658367 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f29b637b-bb0c-4b02-8334-924e71f20b9e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:07.658809 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f29b637b-bb0c-4b02-8334-924e71f20b9e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:07.659558 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f29b637b-bb0c-4b02-8334-924e71f20b9e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:07.659992 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f29b637b-bb0c-4b02-8334-924e71f20b9e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:07.683208 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.objects.instance [None req-f29b637b-bb0c-4b02-8334-924e71f20b9e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lazy-loading 'flavor' on Instance uuid a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 {{(pid=117940) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 18:37:07.943611 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-f29b637b-bb0c-4b02-8334-924e71f20b9e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "POST /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3/action" status: 202 len: 0 microversion: 2.20 time: 0.296125 Jun 30 18:37:07.947469 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 422/848] 10.222.0.33 () {62 vars in 1318 bytes} [Thu Jun 30 18:37:07 2022] POST /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 30 18:37:07.953315 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-575ecc20-947f-41a6-a39a-4d08a5ae1993 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:07.954067 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-575ecc20-947f-41a6-a39a-4d08a5ae1993 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:07.964509 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-575ecc20-947f-41a6-a39a-4d08a5ae1993 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:07.964980 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-575ecc20-947f-41a6-a39a-4d08a5ae1993 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:07.966091 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-575ecc20-947f-41a6-a39a-4d08a5ae1993 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:07.966927 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-575ecc20-947f-41a6-a39a-4d08a5ae1993 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:08.037302 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-80581a8d-633a-428c-9856-c0bc69053e36 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:08.038028 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-80581a8d-633a-428c-9856-c0bc69053e36 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: 44d46d26-912d-40fd-8bd6-5b576e81cf20] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:08.044343 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-80581a8d-633a-428c-9856-c0bc69053e36 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:08.044781 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-80581a8d-633a-428c-9856-c0bc69053e36 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:08.045526 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-80581a8d-633a-428c-9856-c0bc69053e36 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:08.045979 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-80581a8d-633a-428c-9856-c0bc69053e36 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:08.185914 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-575ecc20-947f-41a6-a39a-4d08a5ae1993 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:08.194713 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-575ecc20-947f-41a6-a39a-4d08a5ae1993 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:08.196199 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-575ecc20-947f-41a6-a39a-4d08a5ae1993 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:08.197359 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-575ecc20-947f-41a6-a39a-4d08a5ae1993 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1724 microversion: 2.20 time: 0.248924 Jun 30 18:37:08.197915 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 427/849] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:37:07 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1724 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:37:08.202280 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-a4496716-891c-4242-ac1a-a1b44ae67617 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:08.202870 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-a4496716-891c-4242-ac1a-a1b44ae67617 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: a70367a4-54b1-405e-9b10-5356217349d4] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:08.209152 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a4496716-891c-4242-ac1a-a1b44ae67617 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:08.209603 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a4496716-891c-4242-ac1a-a1b44ae67617 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:08.210372 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a4496716-891c-4242-ac1a-a1b44ae67617 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:08.210798 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a4496716-891c-4242-ac1a-a1b44ae67617 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:08.225126 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-80581a8d-633a-428c-9856-c0bc69053e36 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:08.232594 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-80581a8d-633a-428c-9856-c0bc69053e36 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20" status: 200 len: 1577 microversion: 2.1 time: 0.200935 Jun 30 18:37:08.233162 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 423/850] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:37:08 2022] GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20 => generated 1577 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:37:08.341410 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-a4496716-891c-4242-ac1a-a1b44ae67617 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:08.349211 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-a4496716-891c-4242-ac1a-a1b44ae67617 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4" status: 200 len: 1364 microversion: 2.1 time: 0.150371 Jun 30 18:37:08.349799 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 428/851] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:37:08 2022] GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:37:09.168795 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [req-049cdb50-0182-419d-8ea3-dbb29d3fae21 req-fdf6e648-69b1-41ed-b3d8-db99088dbf4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a70367a4-54b1-405e-9b10-5356217349d4", "name": "network-vif-plugged", "status": "completed", "tag": "1664f24e-d445-414c-9bb0-934bafacdaa9"}]} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:37:09.180367 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-049cdb50-0182-419d-8ea3-dbb29d3fae21 req-fdf6e648-69b1-41ed-b3d8-db99088dbf4f service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:09.180871 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-049cdb50-0182-419d-8ea3-dbb29d3fae21 req-fdf6e648-69b1-41ed-b3d8-db99088dbf4f service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:09.193208 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.compute.server_external_events [req-049cdb50-0182-419d-8ea3-dbb29d3fae21 req-fdf6e648-69b1-41ed-b3d8-db99088dbf4f service nova] Creating event network-vif-plugged:1664f24e-d445-414c-9bb0-934bafacdaa9 for instance a70367a4-54b1-405e-9b10-5356217349d4 on hv-cinder-80378 Jun 30 18:37:09.199088 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [req-049cdb50-0182-419d-8ea3-dbb29d3fae21 req-fdf6e648-69b1-41ed-b3d8-db99088dbf4f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034609 Jun 30 18:37:09.200105 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 424/852] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:37:09.216590 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-74681797-0f02-4ce7-bbf5-fedd194a0967 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:09.217926 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-74681797-0f02-4ce7-bbf5-fedd194a0967 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:09.225354 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-74681797-0f02-4ce7-bbf5-fedd194a0967 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:09.226073 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-74681797-0f02-4ce7-bbf5-fedd194a0967 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:09.226837 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-74681797-0f02-4ce7-bbf5-fedd194a0967 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:09.227294 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-74681797-0f02-4ce7-bbf5-fedd194a0967 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:09.252019 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-4ae749e0-1dd7-4b05-b734-8988aecafed6 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:09.252819 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-4ae749e0-1dd7-4b05-b734-8988aecafed6 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: 44d46d26-912d-40fd-8bd6-5b576e81cf20] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:09.259521 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-4ae749e0-1dd7-4b05-b734-8988aecafed6 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:09.260099 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-4ae749e0-1dd7-4b05-b734-8988aecafed6 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:09.260945 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-4ae749e0-1dd7-4b05-b734-8988aecafed6 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:09.261702 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-4ae749e0-1dd7-4b05-b734-8988aecafed6 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:09.514512 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-74681797-0f02-4ce7-bbf5-fedd194a0967 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:09.530720 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-74681797-0f02-4ce7-bbf5-fedd194a0967 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:09.532846 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-74681797-0f02-4ce7-bbf5-fedd194a0967 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:09.537171 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-74681797-0f02-4ce7-bbf5-fedd194a0967 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1724 microversion: 2.20 time: 0.325073 Jun 30 18:37:09.550652 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 429/853] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:37:09 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1724 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:37:09.556394 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-6631f6fc-56b2-4786-bd35-89d9bddbe202 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:09.557041 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-6631f6fc-56b2-4786-bd35-89d9bddbe202 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: a70367a4-54b1-405e-9b10-5356217349d4] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:09.563998 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6631f6fc-56b2-4786-bd35-89d9bddbe202 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:09.564929 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6631f6fc-56b2-4786-bd35-89d9bddbe202 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:09.565817 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6631f6fc-56b2-4786-bd35-89d9bddbe202 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:09.566245 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6631f6fc-56b2-4786-bd35-89d9bddbe202 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:09.570618 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-4ae749e0-1dd7-4b05-b734-8988aecafed6 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:09.578084 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-4ae749e0-1dd7-4b05-b734-8988aecafed6 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20" status: 200 len: 1577 microversion: 2.1 time: 0.331321 Jun 30 18:37:09.588623 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 425/854] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:37:09 2022] GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20 => generated 1577 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:37:09.701592 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-6631f6fc-56b2-4786-bd35-89d9bddbe202 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:09.709621 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-6631f6fc-56b2-4786-bd35-89d9bddbe202 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4" status: 200 len: 1364 microversion: 2.1 time: 0.157655 Jun 30 18:37:09.710189 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 430/855] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:37:09 2022] GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:37:09.808655 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [req-b7a763c7-5710-4c08-853e-36b1969f5bc0 req-303b6f9d-6216-41e3-bd8a-0590df774058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44d46d26-912d-40fd-8bd6-5b576e81cf20", "name": "network-vif-deleted", "tag": "b367cc3f-9558-497f-9518-dc0d8b592a5c"}]} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:37:09.818563 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-b7a763c7-5710-4c08-853e-36b1969f5bc0 req-303b6f9d-6216-41e3-bd8a-0590df774058 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:09.819001 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-b7a763c7-5710-4c08-853e-36b1969f5bc0 req-303b6f9d-6216-41e3-bd8a-0590df774058 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:09.836526 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.compute.server_external_events [req-b7a763c7-5710-4c08-853e-36b1969f5bc0 req-303b6f9d-6216-41e3-bd8a-0590df774058 service nova] Creating event network-vif-deleted:b367cc3f-9558-497f-9518-dc0d8b592a5c for instance 44d46d26-912d-40fd-8bd6-5b576e81cf20 on hv-cinder-80378 Jun 30 18:37:09.841817 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [req-b7a763c7-5710-4c08-853e-36b1969f5bc0 req-303b6f9d-6216-41e3-bd8a-0590df774058 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036781 Jun 30 18:37:09.842438 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 426/856] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:37:10.557458 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-1dc01531-7301-4f63-9fb5-c9013988f851 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:10.558878 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-1dc01531-7301-4f63-9fb5-c9013988f851 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:10.562151 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell0:SELECT=2 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:37:10.562806 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell0:SELECT=6 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:37:10.568965 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1dc01531-7301-4f63-9fb5-c9013988f851 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:10.569408 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1dc01531-7301-4f63-9fb5-c9013988f851 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:10.570521 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1dc01531-7301-4f63-9fb5-c9013988f851 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:10.571101 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1dc01531-7301-4f63-9fb5-c9013988f851 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:10.593106 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell0:SELECT=6 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:37:10.598704 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-d2799a2b-8622-4794-aca1-76d2203f3908 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:10.599459 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-d2799a2b-8622-4794-aca1-76d2203f3908 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: 44d46d26-912d-40fd-8bd6-5b576e81cf20] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:10.606246 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d2799a2b-8622-4794-aca1-76d2203f3908 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:10.606693 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d2799a2b-8622-4794-aca1-76d2203f3908 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:10.607906 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d2799a2b-8622-4794-aca1-76d2203f3908 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:10.608533 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d2799a2b-8622-4794-aca1-76d2203f3908 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:10.690433 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-d2799a2b-8622-4794-aca1-76d2203f3908 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:10.698197 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-d2799a2b-8622-4794-aca1-76d2203f3908 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20" status: 200 len: 1225 microversion: 2.1 time: 0.105942 Jun 30 18:37:10.698658 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 427/857] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:37:10 2022] GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20 => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:37:10.726800 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-0238da0d-f468-4e21-9b2f-420518fdfc23 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:10.727875 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-0238da0d-f468-4e21-9b2f-420518fdfc23 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: a70367a4-54b1-405e-9b10-5356217349d4] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:10.734153 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0238da0d-f468-4e21-9b2f-420518fdfc23 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:10.734603 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0238da0d-f468-4e21-9b2f-420518fdfc23 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:10.735849 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0238da0d-f468-4e21-9b2f-420518fdfc23 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:10.736528 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0238da0d-f468-4e21-9b2f-420518fdfc23 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:10.753399 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-1dc01531-7301-4f63-9fb5-c9013988f851 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:10.756961 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:37:10.763042 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-1dc01531-7301-4f63-9fb5-c9013988f851 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:10.764523 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-1dc01531-7301-4f63-9fb5-c9013988f851 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:10.765700 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-1dc01531-7301-4f63-9fb5-c9013988f851 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1724 microversion: 2.20 time: 0.212263 Jun 30 18:37:10.766897 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 431/858] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:37:10 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:37:10.881155 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-0238da0d-f468-4e21-9b2f-420518fdfc23 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:10.885988 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:37:10.892212 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-0238da0d-f468-4e21-9b2f-420518fdfc23 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4" status: 200 len: 1364 microversion: 2.1 time: 0.169244 Jun 30 18:37:10.892888 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 428/859] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:37:10 2022] GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:37:11.716299 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-faca107c-ed39-49b2-987b-b8b6e35ae0e6 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:11.716903 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-faca107c-ed39-49b2-987b-b8b6e35ae0e6 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: 44d46d26-912d-40fd-8bd6-5b576e81cf20] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:11.724809 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-faca107c-ed39-49b2-987b-b8b6e35ae0e6 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:11.725243 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-faca107c-ed39-49b2-987b-b8b6e35ae0e6 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:11.726020 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-faca107c-ed39-49b2-987b-b8b6e35ae0e6 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:11.726441 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-faca107c-ed39-49b2-987b-b8b6e35ae0e6 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:11.756955 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-faca107c-ed39-49b2-987b-b8b6e35ae0e6 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:11.757392 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-faca107c-ed39-49b2-987b-b8b6e35ae0e6 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:11.757855 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.objects.instance [None req-faca107c-ed39-49b2-987b-b8b6e35ae0e6 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lazy-loading 'fault' on Instance uuid 44d46d26-912d-40fd-8bd6-5b576e81cf20 {{(pid=117941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 18:37:11.785237 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-2bf6b333-f6da-40f2-8be2-0ccb45adae5e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:11.785881 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-2bf6b333-f6da-40f2-8be2-0ccb45adae5e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:11.792932 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-2bf6b333-f6da-40f2-8be2-0ccb45adae5e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:11.793380 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-2bf6b333-f6da-40f2-8be2-0ccb45adae5e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:11.794364 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-2bf6b333-f6da-40f2-8be2-0ccb45adae5e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:11.794806 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-2bf6b333-f6da-40f2-8be2-0ccb45adae5e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:11.802959 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-faca107c-ed39-49b2-987b-b8b6e35ae0e6 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:11.811033 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-faca107c-ed39-49b2-987b-b8b6e35ae0e6 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20" status: 200 len: 1230 microversion: 2.1 time: 0.099051 Jun 30 18:37:11.811645 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 432/860] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:37:11 2022] GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20 => generated 1230 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:37:11.911594 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-56dafcfd-3a36-4153-b83f-a722935baaa8 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:11.912257 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-56dafcfd-3a36-4153-b83f-a722935baaa8 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: a70367a4-54b1-405e-9b10-5356217349d4] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:11.919228 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-56dafcfd-3a36-4153-b83f-a722935baaa8 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:11.919657 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-56dafcfd-3a36-4153-b83f-a722935baaa8 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:11.920424 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-56dafcfd-3a36-4153-b83f-a722935baaa8 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:11.920856 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-56dafcfd-3a36-4153-b83f-a722935baaa8 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:12.022472 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-2bf6b333-f6da-40f2-8be2-0ccb45adae5e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:12.035323 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-2bf6b333-f6da-40f2-8be2-0ccb45adae5e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:12.037947 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-2bf6b333-f6da-40f2-8be2-0ccb45adae5e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:12.039215 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-2bf6b333-f6da-40f2-8be2-0ccb45adae5e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1724 microversion: 2.20 time: 0.259079 Jun 30 18:37:12.041795 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 429/861] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:37:11 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1724 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 18:37:12.100058 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-56dafcfd-3a36-4153-b83f-a722935baaa8 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:12.107389 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-56dafcfd-3a36-4153-b83f-a722935baaa8 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4" status: 200 len: 1550 microversion: 2.1 time: 0.200578 Jun 30 18:37:12.107936 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 433/862] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:37:11 2022] GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4 => generated 1550 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:37:12.124061 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-d48e8fbc-0562-4d54-80b8-79d9e463771d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:12.124551 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-d48e8fbc-0562-4d54-80b8-79d9e463771d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: a70367a4-54b1-405e-9b10-5356217349d4] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:12.131358 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d48e8fbc-0562-4d54-80b8-79d9e463771d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:12.131734 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d48e8fbc-0562-4d54-80b8-79d9e463771d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:12.132492 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d48e8fbc-0562-4d54-80b8-79d9e463771d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:12.132925 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d48e8fbc-0562-4d54-80b8-79d9e463771d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:12.212980 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-d48e8fbc-0562-4d54-80b8-79d9e463771d tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092729 Jun 30 18:37:12.213875 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 430/863] 10.222.0.33 () {58 vars in 1274 bytes} [Thu Jun 30 18:37:12 2022] GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:37:12.831474 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-78d68c95-6d4e-48ca-beeb-ed787db7bb05 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:12.832082 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-78d68c95-6d4e-48ca-beeb-ed787db7bb05 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: 44d46d26-912d-40fd-8bd6-5b576e81cf20] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:12.839140 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-78d68c95-6d4e-48ca-beeb-ed787db7bb05 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:12.839581 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-78d68c95-6d4e-48ca-beeb-ed787db7bb05 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:12.840335 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-78d68c95-6d4e-48ca-beeb-ed787db7bb05 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:12.840760 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-78d68c95-6d4e-48ca-beeb-ed787db7bb05 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:12.854593 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.wsgi [None req-78d68c95-6d4e-48ca-beeb-ed787db7bb05 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] HTTP exception thrown: Instance 44d46d26-912d-40fd-8bd6-5b576e81cf20 could not be found. Jun 30 18:37:12.856232 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-78d68c95-6d4e-48ca-beeb-ed787db7bb05 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Request method failure captured: Jun 30 18:37:12.856232 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: request: GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20 HTTP/1.1 Jun 30 18:37:12.856232 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept: application/json Jun 30 18:37:12.856232 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept-Encoding: identity Jun 30 18:37:12.856232 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Connection: close Jun 30 18:37:12.856232 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Length: 0 Jun 30 18:37:12.856232 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Type: application/json Jun 30 18:37:12.856232 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Host: 10.222.0.33 Jun 30 18:37:12.856232 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Openstack-System-Scope: None Jun 30 18:37:12.856232 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: User-Agent: python-urllib3/1.26.9 Jun 30 18:37:12.856232 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Auth-Token: gAAAAABiveyK8TH-8E6opIMiZgHOT15c88aE9wFV_DnS2JDw_PHcFiDa0g0Nh0vqnDSVG-tczSdKpb9L9Rpmy1PfEikb75Mg4K5xnk9MGICOlzKjcukAq_wRIHkhnDaevuF741H6YMcoIX-itp6TdgiqJRK5q3wGBAcPdIBfRsu4DwkfWb953Gg Jun 30 18:37:12.856232 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Id: None Jun 30 18:37:12.856232 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Name: None Jun 30 18:37:12.856232 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Identity-Status: Confirmed Jun 30 18:37:12.856232 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Is-Admin-Project: True Jun 30 18:37:12.856232 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Id: default Jun 30 18:37:12.856232 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Name: Default Jun 30 18:37:12.856232 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Id: 64655c9e82bb4515a976f41ac93b242f Jun 30 18:37:12.856232 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Name: tempest-TestVolumeBootPattern-2010085685 Jun 30 18:37:12.856232 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Role: reader,member Jun 30 18:37:12.856232 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Roles: reader,member Jun 30 18:37:12.857958 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/64655c9e82bb4515a976f41ac93b242f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_64655c9e82bb4515a976f41ac93b242f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/64655c9e82bb4515a976f41ac93b242f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/64655c9e82bb4515a976f41ac93b242f"}]}] Jun 30 18:37:12.857958 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant: tempest-TestVolumeBootPattern-2010085685 Jun 30 18:37:12.857958 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Id: 64655c9e82bb4515a976f41ac93b242f Jun 30 18:37:12.857958 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Name: tempest-TestVolumeBootPattern-2010085685 Jun 30 18:37:12.857958 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User: tempest-TestVolumeBootPattern-2010085685-project Jun 30 18:37:12.857958 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Id: default Jun 30 18:37:12.857958 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Name: Default Jun 30 18:37:12.857958 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Id: 31c0594d0be84154a601d625bca699cd Jun 30 18:37:12.857958 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Name: tempest-TestVolumeBootPattern-2010085685-project Jun 30 18:37:12.857958 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: method: > Jun 30 18:37:12.857958 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: exception: Instance 44d46d26-912d-40fd-8bd6-5b576e81cf20 could not be found. Jun 30 18:37:12.857958 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: action_args: {'id': '44d46d26-912d-40fd-8bd6-5b576e81cf20'} Jun 30 18:37:12.858980 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:37:12.858980 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:37:12.858980 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:37:12.858980 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:37:12.858980 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:37:12.858980 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:37:12.858980 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:37:12.858980 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:37:12.858980 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:37:12.858980 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:37:12.858980 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44d46d26-912d-40fd-8bd6-5b576e81cf20 could not be found. Jun 30 18:37:12.858980 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:37:12.858980 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:37:12.858980 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:37:12.858980 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:37:12.858980 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:37:12.858980 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:37:12.858980 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:37:12.858980 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:37:12.858980 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:37:12.860328 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:37:12.860328 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:37:12.860328 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:37:12.860328 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:37:12.860328 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:37:12.860328 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:37:12.860328 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:37:12.860328 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44d46d26-912d-40fd-8bd6-5b576e81cf20 could not be found. Jun 30 18:37:12.860328 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:37:12.860328 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:37:12.860328 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:37:12.860328 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:37:12.860328 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:37:12.860328 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:37:12.860328 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:37:12.860328 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:37:12.860328 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44d46d26-912d-40fd-8bd6-5b576e81cf20 could not be found. Jun 30 18:37:12.860328 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:37:12.861546 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-78d68c95-6d4e-48ca-beeb-ed787db7bb05 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Returning 404 to user: Instance 44d46d26-912d-40fd-8bd6-5b576e81cf20 could not be found. {{(pid=117941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:37:12.861546 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-78d68c95-6d4e-48ca-beeb-ed787db7bb05 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20" status: 404 len: 111 microversion: 2.1 time: 0.030579 Jun 30 18:37:12.861546 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 434/864] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:37:12 2022] GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:37:12.956632 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-bde7c5f3-5955-4a81-a831-91f4080dae5f tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1968754452", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-274103547", "security_groups": [{"name": "tempest-secgroup-smoke-1376425930"}], "block_device_mapping_v2": [{"uuid": "d794a9b0-9e30-4bf8-b03e-ad4ad59d36d7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2fc6fe0c-6090-4d20-bc8a-e6954c35f796"}]}} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:37:13.060002 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-743628d5-c15c-4812-af9b-e210213273f7 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:13.061101 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-743628d5-c15c-4812-af9b-e210213273f7 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:13.068264 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-743628d5-c15c-4812-af9b-e210213273f7 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:13.068847 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-743628d5-c15c-4812-af9b-e210213273f7 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:13.069718 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-743628d5-c15c-4812-af9b-e210213273f7 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:13.070220 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-743628d5-c15c-4812-af9b-e210213273f7 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:13.328240 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.network.neutron [None req-bde7c5f3-5955-4a81-a831-91f4080dae5f tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] validate_networks() for [('2fc6fe0c-6090-4d20-bc8a-e6954c35f796', None, None, None, None, None)] {{(pid=117940) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 18:37:13.412432 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-743628d5-c15c-4812-af9b-e210213273f7 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:13.421134 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-743628d5-c15c-4812-af9b-e210213273f7 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:13.423398 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-743628d5-c15c-4812-af9b-e210213273f7 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:13.424570 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-743628d5-c15c-4812-af9b-e210213273f7 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1724 microversion: 2.20 time: 0.369455 Jun 30 18:37:13.425134 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 435/865] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:37:13 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1724 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 18:37:13.663737 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-3fa9b76d-613e-41c5-8e00-98440c0175e7 req-48fc9777-4057-4e9d-ad28-c3d22d8d0e6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a70367a4-54b1-405e-9b10-5356217349d4", "tag": "1664f24e-d445-414c-9bb0-934bafacdaa9"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:37:13.671901 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-3fa9b76d-613e-41c5-8e00-98440c0175e7 req-48fc9777-4057-4e9d-ad28-c3d22d8d0e6f service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:13.672342 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-3fa9b76d-613e-41c5-8e00-98440c0175e7 req-48fc9777-4057-4e9d-ad28-c3d22d8d0e6f service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:13.684540 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.compute.server_external_events [req-3fa9b76d-613e-41c5-8e00-98440c0175e7 req-48fc9777-4057-4e9d-ad28-c3d22d8d0e6f service nova] Creating event network-changed:1664f24e-d445-414c-9bb0-934bafacdaa9 for instance a70367a4-54b1-405e-9b10-5356217349d4 on hv-cinder-80378 Jun 30 18:37:13.690542 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-3fa9b76d-613e-41c5-8e00-98440c0175e7 req-48fc9777-4057-4e9d-ad28-c3d22d8d0e6f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035317 Jun 30 18:37:13.691237 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 436/866] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:37:13.869886 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-bde7c5f3-5955-4a81-a831-91f4080dae5f tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Flavor limits 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 18:37:13.870560 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-bde7c5f3-5955-4a81-a831-91f4080dae5f tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Image limits 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 18:37:13.871224 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-bde7c5f3-5955-4a81-a831-91f4080dae5f tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Flavor pref 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 18:37:13.871832 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-bde7c5f3-5955-4a81-a831-91f4080dae5f tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Image pref 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 18:37:13.872303 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-bde7c5f3-5955-4a81-a831-91f4080dae5f tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 18:37:13.882091 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-bde7c5f3-5955-4a81-a831-91f4080dae5f tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:13.882818 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-bde7c5f3-5955-4a81-a831-91f4080dae5f tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:13.883617 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-bde7c5f3-5955-4a81-a831-91f4080dae5f tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:13.884050 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-bde7c5f3-5955-4a81-a831-91f4080dae5f tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:13.902492 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.quota [None req-bde7c5f3-5955-4a81-a831-91f4080dae5f tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Getting quotas for project 64655c9e82bb4515a976f41ac93b242f. Resources: {'ram', 'instances', 'cores'} {{(pid=117940) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 18:37:13.907861 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.quota [None req-bde7c5f3-5955-4a81-a831-91f4080dae5f tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Getting quotas for user 31c0594d0be84154a601d625bca699cd and project 64655c9e82bb4515a976f41ac93b242f. Resources: {'ram', 'instances', 'cores'} {{(pid=117940) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 18:37:13.971340 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-bde7c5f3-5955-4a81-a831-91f4080dae5f tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Going to run 1 instances... {{(pid=117940) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 18:37:13.974364 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-bde7c5f3-5955-4a81-a831-91f4080dae5f tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: d718c533-1949-4ce7-a767-bdc51f16293a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d794a9b0-9e30-4bf8-b03e-ad4ad59d36d7',volume_size=None,volume_type=None)] {{(pid=117940) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 18:37:14.133932 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-bde7c5f3-5955-4a81-a831-91f4080dae5f tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.181842 Jun 30 18:37:14.135123 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 431/867] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 30 18:37:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 1184 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 30 18:37:14.149197 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-02b4bccc-abab-420c-ab19-e944a65bb721 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:14.152304 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-02b4bccc-abab-420c-ab19-e944a65bb721 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: d718c533-1949-4ce7-a767-bdc51f16293a] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:14.250100 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-02b4bccc-abab-420c-ab19-e944a65bb721 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:14.260561 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-02b4bccc-abab-420c-ab19-e944a65bb721 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a" status: 200 len: 1094 microversion: 2.1 time: 0.117628 Jun 30 18:37:14.261769 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 437/868] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:37:14 2022] GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a => generated 1094 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:37:14.443125 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-b2df56cd-e773-48be-b91e-aaf6ec919f50 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:14.443735 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-b2df56cd-e773-48be-b91e-aaf6ec919f50 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:14.450599 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b2df56cd-e773-48be-b91e-aaf6ec919f50 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:14.451049 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b2df56cd-e773-48be-b91e-aaf6ec919f50 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:14.451814 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b2df56cd-e773-48be-b91e-aaf6ec919f50 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:14.452248 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b2df56cd-e773-48be-b91e-aaf6ec919f50 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:14.616388 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-b2df56cd-e773-48be-b91e-aaf6ec919f50 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:14.625495 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-b2df56cd-e773-48be-b91e-aaf6ec919f50 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:14.627363 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-b2df56cd-e773-48be-b91e-aaf6ec919f50 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:14.628672 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-b2df56cd-e773-48be-b91e-aaf6ec919f50 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1724 microversion: 2.20 time: 0.189667 Jun 30 18:37:14.629906 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 432/869] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:37:14 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:37:15.277948 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-ec7c0517-3a04-4506-a67e-e9b8992512ff tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:15.278840 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-ec7c0517-3a04-4506-a67e-e9b8992512ff tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: d718c533-1949-4ce7-a767-bdc51f16293a] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:15.288555 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ec7c0517-3a04-4506-a67e-e9b8992512ff tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:15.289746 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ec7c0517-3a04-4506-a67e-e9b8992512ff tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:15.290627 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ec7c0517-3a04-4506-a67e-e9b8992512ff tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:15.291353 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ec7c0517-3a04-4506-a67e-e9b8992512ff tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:15.357071 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-ec7c0517-3a04-4506-a67e-e9b8992512ff tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:15.365657 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-ec7c0517-3a04-4506-a67e-e9b8992512ff tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a" status: 200 len: 1210 microversion: 2.1 time: 0.091845 Jun 30 18:37:15.366498 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 438/870] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:37:15 2022] GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a => generated 1210 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:37:15.647635 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-3af9c258-2ff1-4646-869e-a88ebb4a43ae tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:15.648254 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-3af9c258-2ff1-4646-869e-a88ebb4a43ae tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:15.655740 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3af9c258-2ff1-4646-869e-a88ebb4a43ae tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:15.656239 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3af9c258-2ff1-4646-869e-a88ebb4a43ae tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:15.657011 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3af9c258-2ff1-4646-869e-a88ebb4a43ae tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:15.658071 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3af9c258-2ff1-4646-869e-a88ebb4a43ae tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:15.792317 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-3af9c258-2ff1-4646-869e-a88ebb4a43ae tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:15.801408 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-3af9c258-2ff1-4646-869e-a88ebb4a43ae tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:15.802927 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-3af9c258-2ff1-4646-869e-a88ebb4a43ae tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:15.804070 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-3af9c258-2ff1-4646-869e-a88ebb4a43ae tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1724 microversion: 2.20 time: 0.160629 Jun 30 18:37:15.804634 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 433/871] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:37:15 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 18:37:16.383385 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-ac00194d-077f-48b9-b88e-075cd59ea74c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:16.384113 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-ac00194d-077f-48b9-b88e-075cd59ea74c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: d718c533-1949-4ce7-a767-bdc51f16293a] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:16.390672 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ac00194d-077f-48b9-b88e-075cd59ea74c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:16.391195 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ac00194d-077f-48b9-b88e-075cd59ea74c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:16.392029 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ac00194d-077f-48b9-b88e-075cd59ea74c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:16.392534 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ac00194d-077f-48b9-b88e-075cd59ea74c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:16.544410 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-ac00194d-077f-48b9-b88e-075cd59ea74c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:16.554240 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-ac00194d-077f-48b9-b88e-075cd59ea74c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a" status: 200 len: 1266 microversion: 2.1 time: 0.174080 Jun 30 18:37:16.556216 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 439/872] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:37:16 2022] GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:37:16.666990 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [req-a5130747-990c-4599-87b0-6191131212e1 req-db60e72b-1b06-4f6a-9cfd-05aeff5c84f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d718c533-1949-4ce7-a767-bdc51f16293a", "tag": "ba3cd163-a8e4-46d4-ab5e-d19b0f7bd916"}]} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:37:16.677092 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-a5130747-990c-4599-87b0-6191131212e1 req-db60e72b-1b06-4f6a-9cfd-05aeff5c84f3 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:16.677891 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-a5130747-990c-4599-87b0-6191131212e1 req-db60e72b-1b06-4f6a-9cfd-05aeff5c84f3 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:16.693507 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.compute.server_external_events [req-a5130747-990c-4599-87b0-6191131212e1 req-db60e72b-1b06-4f6a-9cfd-05aeff5c84f3 service nova] Creating event network-changed:ba3cd163-a8e4-46d4-ab5e-d19b0f7bd916 for instance d718c533-1949-4ce7-a767-bdc51f16293a on hv-cinder-80378 Jun 30 18:37:16.699498 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [req-a5130747-990c-4599-87b0-6191131212e1 req-db60e72b-1b06-4f6a-9cfd-05aeff5c84f3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036194 Jun 30 18:37:16.700108 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 434/873] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:37:16.823679 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-57f9dff1-a25b-4c7c-beb0-53fe11fb3341 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:16.824277 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-57f9dff1-a25b-4c7c-beb0-53fe11fb3341 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:16.832447 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-57f9dff1-a25b-4c7c-beb0-53fe11fb3341 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:16.833193 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-57f9dff1-a25b-4c7c-beb0-53fe11fb3341 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:16.834177 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-57f9dff1-a25b-4c7c-beb0-53fe11fb3341 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:16.834763 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-57f9dff1-a25b-4c7c-beb0-53fe11fb3341 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:17.002522 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-57f9dff1-a25b-4c7c-beb0-53fe11fb3341 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:17.011910 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-57f9dff1-a25b-4c7c-beb0-53fe11fb3341 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:17.013437 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-57f9dff1-a25b-4c7c-beb0-53fe11fb3341 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:17.014851 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-57f9dff1-a25b-4c7c-beb0-53fe11fb3341 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1724 microversion: 2.20 time: 0.195407 Jun 30 18:37:17.015414 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 440/874] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:37:16 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:37:17.573230 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-1699ea98-4c4f-4cee-9503-3d2bb3f2d041 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:17.574028 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-1699ea98-4c4f-4cee-9503-3d2bb3f2d041 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: d718c533-1949-4ce7-a767-bdc51f16293a] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:17.580263 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-1699ea98-4c4f-4cee-9503-3d2bb3f2d041 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:17.580790 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-1699ea98-4c4f-4cee-9503-3d2bb3f2d041 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:17.581648 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-1699ea98-4c4f-4cee-9503-3d2bb3f2d041 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:17.582157 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-1699ea98-4c4f-4cee-9503-3d2bb3f2d041 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:17.720329 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-1699ea98-4c4f-4cee-9503-3d2bb3f2d041 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:17.728728 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-1699ea98-4c4f-4cee-9503-3d2bb3f2d041 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a" status: 200 len: 1266 microversion: 2.1 time: 0.160108 Jun 30 18:37:17.729303 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 435/875] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:37:17 2022] GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:37:18.034020 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-3f78cef6-1419-4a28-aceb-927c6997e26a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:18.034742 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-3f78cef6-1419-4a28-aceb-927c6997e26a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:18.041404 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3f78cef6-1419-4a28-aceb-927c6997e26a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:18.041882 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3f78cef6-1419-4a28-aceb-927c6997e26a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:18.042645 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3f78cef6-1419-4a28-aceb-927c6997e26a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:18.043078 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3f78cef6-1419-4a28-aceb-927c6997e26a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:18.180436 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-3f78cef6-1419-4a28-aceb-927c6997e26a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:18.188217 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-3f78cef6-1419-4a28-aceb-927c6997e26a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:18.191961 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-3f78cef6-1419-4a28-aceb-927c6997e26a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:18.193127 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-3f78cef6-1419-4a28-aceb-927c6997e26a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1724 microversion: 2.20 time: 0.163952 Jun 30 18:37:18.193724 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 441/876] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:37:18 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:37:18.747623 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-b3927755-8081-475b-9b5c-8b31df381d58 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:18.748334 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-b3927755-8081-475b-9b5c-8b31df381d58 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: d718c533-1949-4ce7-a767-bdc51f16293a] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:18.755692 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b3927755-8081-475b-9b5c-8b31df381d58 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:18.756128 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b3927755-8081-475b-9b5c-8b31df381d58 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:18.756928 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b3927755-8081-475b-9b5c-8b31df381d58 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:18.757367 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b3927755-8081-475b-9b5c-8b31df381d58 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:18.890570 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-b3927755-8081-475b-9b5c-8b31df381d58 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:18.898234 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-b3927755-8081-475b-9b5c-8b31df381d58 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a" status: 200 len: 1266 microversion: 2.1 time: 0.154746 Jun 30 18:37:18.898795 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 436/877] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:37:18 2022] GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:37:19.211339 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-09833896-3920-40d2-97f2-f50078b54947 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:19.211944 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-09833896-3920-40d2-97f2-f50078b54947 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:19.218689 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-09833896-3920-40d2-97f2-f50078b54947 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:19.219135 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-09833896-3920-40d2-97f2-f50078b54947 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:19.219887 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-09833896-3920-40d2-97f2-f50078b54947 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:19.220319 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-09833896-3920-40d2-97f2-f50078b54947 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:19.348651 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-09833896-3920-40d2-97f2-f50078b54947 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:19.356493 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-09833896-3920-40d2-97f2-f50078b54947 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:19.358302 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-09833896-3920-40d2-97f2-f50078b54947 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:19.359455 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-09833896-3920-40d2-97f2-f50078b54947 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1724 microversion: 2.20 time: 0.152000 Jun 30 18:37:19.360006 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 442/878] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:37:19 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:37:19.916011 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-d7b628a6-2560-41ee-b422-bde894ddd02f tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:19.916541 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-d7b628a6-2560-41ee-b422-bde894ddd02f tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: d718c533-1949-4ce7-a767-bdc51f16293a] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:19.923227 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d7b628a6-2560-41ee-b422-bde894ddd02f tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:19.923699 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d7b628a6-2560-41ee-b422-bde894ddd02f tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:19.925692 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d7b628a6-2560-41ee-b422-bde894ddd02f tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:19.926133 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d7b628a6-2560-41ee-b422-bde894ddd02f tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:20.061699 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-d7b628a6-2560-41ee-b422-bde894ddd02f tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:20.069146 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-d7b628a6-2560-41ee-b422-bde894ddd02f tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a" status: 200 len: 1266 microversion: 2.1 time: 0.157086 Jun 30 18:37:20.069743 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 437/879] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:37:19 2022] GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:37:20.378498 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-1d3466b8-8ae5-4fd0-8019-1932280014a2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:20.379137 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-1d3466b8-8ae5-4fd0-8019-1932280014a2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:20.385538 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1d3466b8-8ae5-4fd0-8019-1932280014a2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:20.386007 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1d3466b8-8ae5-4fd0-8019-1932280014a2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:20.386757 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1d3466b8-8ae5-4fd0-8019-1932280014a2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:20.387184 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1d3466b8-8ae5-4fd0-8019-1932280014a2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:20.512928 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-1d3466b8-8ae5-4fd0-8019-1932280014a2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:20.521270 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-1d3466b8-8ae5-4fd0-8019-1932280014a2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:20.522795 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-1d3466b8-8ae5-4fd0-8019-1932280014a2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:20.523946 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-1d3466b8-8ae5-4fd0-8019-1932280014a2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1745 microversion: 2.20 time: 0.149910 Jun 30 18:37:20.524499 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 443/880] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:37:20 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1745 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:37:21.086120 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-c6c37dca-c63c-4cc0-be56-67bf045b93c9 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:21.086758 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-c6c37dca-c63c-4cc0-be56-67bf045b93c9 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: d718c533-1949-4ce7-a767-bdc51f16293a] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:21.093435 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c6c37dca-c63c-4cc0-be56-67bf045b93c9 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:21.093920 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c6c37dca-c63c-4cc0-be56-67bf045b93c9 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:21.094679 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c6c37dca-c63c-4cc0-be56-67bf045b93c9 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:21.095112 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c6c37dca-c63c-4cc0-be56-67bf045b93c9 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:21.229611 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-c6c37dca-c63c-4cc0-be56-67bf045b93c9 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:21.237496 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-c6c37dca-c63c-4cc0-be56-67bf045b93c9 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a" status: 200 len: 1266 microversion: 2.1 time: 0.154656 Jun 30 18:37:21.238167 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 438/881] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:37:21 2022] GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:37:21.542527 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-cf40da9b-d108-460b-9ae5-97eccd0676d6 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:21.543127 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-cf40da9b-d108-460b-9ae5-97eccd0676d6 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:21.549837 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-cf40da9b-d108-460b-9ae5-97eccd0676d6 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:21.550276 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-cf40da9b-d108-460b-9ae5-97eccd0676d6 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:21.551027 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-cf40da9b-d108-460b-9ae5-97eccd0676d6 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:21.551456 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-cf40da9b-d108-460b-9ae5-97eccd0676d6 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:21.680137 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-cf40da9b-d108-460b-9ae5-97eccd0676d6 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:21.688135 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-cf40da9b-d108-460b-9ae5-97eccd0676d6 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:21.689648 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-cf40da9b-d108-460b-9ae5-97eccd0676d6 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:21.690844 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-cf40da9b-d108-460b-9ae5-97eccd0676d6 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1745 microversion: 2.20 time: 0.152665 Jun 30 18:37:21.691395 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 444/882] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:37:21 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 18:37:22.254861 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-819c2874-fe76-499b-b6db-3ebfc2dc75e7 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:22.255464 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-819c2874-fe76-499b-b6db-3ebfc2dc75e7 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: d718c533-1949-4ce7-a767-bdc51f16293a] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:22.257847 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:37:22.263637 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-819c2874-fe76-499b-b6db-3ebfc2dc75e7 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:22.264076 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-819c2874-fe76-499b-b6db-3ebfc2dc75e7 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:22.264824 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-819c2874-fe76-499b-b6db-3ebfc2dc75e7 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:22.265268 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-819c2874-fe76-499b-b6db-3ebfc2dc75e7 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:22.395731 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-819c2874-fe76-499b-b6db-3ebfc2dc75e7 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:22.403327 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-819c2874-fe76-499b-b6db-3ebfc2dc75e7 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a" status: 200 len: 1266 microversion: 2.1 time: 0.153178 Jun 30 18:37:22.403900 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 439/883] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:37:22 2022] GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:37:22.709333 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-a6ccaa12-db1c-465e-a8fe-feb3feb33d20 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:22.709970 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-a6ccaa12-db1c-465e-a8fe-feb3feb33d20 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:22.712385 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:37:22.718200 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a6ccaa12-db1c-465e-a8fe-feb3feb33d20 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:22.718638 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a6ccaa12-db1c-465e-a8fe-feb3feb33d20 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:22.719383 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a6ccaa12-db1c-465e-a8fe-feb3feb33d20 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:22.719814 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a6ccaa12-db1c-465e-a8fe-feb3feb33d20 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:22.854711 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-a6ccaa12-db1c-465e-a8fe-feb3feb33d20 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:22.862591 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-a6ccaa12-db1c-465e-a8fe-feb3feb33d20 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:22.864077 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-a6ccaa12-db1c-465e-a8fe-feb3feb33d20 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:22.865220 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-a6ccaa12-db1c-465e-a8fe-feb3feb33d20 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1745 microversion: 2.20 time: 0.159887 Jun 30 18:37:22.865812 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 445/884] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:37:22 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:37:23.420308 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-6284fd37-8972-4052-a2ad-4e3067c1d523 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:23.420851 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-6284fd37-8972-4052-a2ad-4e3067c1d523 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: d718c533-1949-4ce7-a767-bdc51f16293a] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:23.428297 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6284fd37-8972-4052-a2ad-4e3067c1d523 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:23.428742 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6284fd37-8972-4052-a2ad-4e3067c1d523 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:23.429494 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6284fd37-8972-4052-a2ad-4e3067c1d523 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:23.429949 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6284fd37-8972-4052-a2ad-4e3067c1d523 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:23.559831 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-6284fd37-8972-4052-a2ad-4e3067c1d523 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:23.567579 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-6284fd37-8972-4052-a2ad-4e3067c1d523 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a" status: 200 len: 1266 microversion: 2.1 time: 0.151229 Jun 30 18:37:23.568257 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 440/885] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:37:23 2022] GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:37:23.884339 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-344a1887-65a1-45ba-bd22-ace5ed0c74e2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:23.884928 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-344a1887-65a1-45ba-bd22-ace5ed0c74e2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:23.891349 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-344a1887-65a1-45ba-bd22-ace5ed0c74e2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:23.891786 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-344a1887-65a1-45ba-bd22-ace5ed0c74e2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:23.892525 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-344a1887-65a1-45ba-bd22-ace5ed0c74e2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:23.892956 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-344a1887-65a1-45ba-bd22-ace5ed0c74e2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:24.027044 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-344a1887-65a1-45ba-bd22-ace5ed0c74e2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:24.036556 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-344a1887-65a1-45ba-bd22-ace5ed0c74e2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:24.038101 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-344a1887-65a1-45ba-bd22-ace5ed0c74e2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:24.039283 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-344a1887-65a1-45ba-bd22-ace5ed0c74e2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1745 microversion: 2.20 time: 0.158849 Jun 30 18:37:24.039837 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 446/886] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:37:23 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:37:24.581888 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell0:SELECT=2 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:37:24.582616 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell0:SELECT=6 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:37:24.587985 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-a538b119-51ef-446a-a3a1-e5584ef60650 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:24.588622 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-a538b119-51ef-446a-a3a1-e5584ef60650 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: d718c533-1949-4ce7-a767-bdc51f16293a] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:24.597087 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a538b119-51ef-446a-a3a1-e5584ef60650 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:24.597837 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a538b119-51ef-446a-a3a1-e5584ef60650 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:24.598696 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a538b119-51ef-446a-a3a1-e5584ef60650 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:24.599115 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a538b119-51ef-446a-a3a1-e5584ef60650 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:24.730094 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-a538b119-51ef-446a-a3a1-e5584ef60650 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:24.738084 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-a538b119-51ef-446a-a3a1-e5584ef60650 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a" status: 200 len: 1266 microversion: 2.1 time: 0.157326 Jun 30 18:37:24.738645 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 441/887] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:37:24 2022] GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:37:25.057805 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-a78d4d25-2853-4a8d-a4fc-5c6378a13574 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:25.058428 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-a78d4d25-2853-4a8d-a4fc-5c6378a13574 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:25.060226 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell0:SELECT=2 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:37:25.066965 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a78d4d25-2853-4a8d-a4fc-5c6378a13574 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:25.067413 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a78d4d25-2853-4a8d-a4fc-5c6378a13574 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:25.068184 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a78d4d25-2853-4a8d-a4fc-5c6378a13574 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:25.068621 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a78d4d25-2853-4a8d-a4fc-5c6378a13574 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:25.361341 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-a78d4d25-2853-4a8d-a4fc-5c6378a13574 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:25.370024 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-a78d4d25-2853-4a8d-a4fc-5c6378a13574 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:25.371491 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-a78d4d25-2853-4a8d-a4fc-5c6378a13574 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:25.372615 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-a78d4d25-2853-4a8d-a4fc-5c6378a13574 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1745 microversion: 2.20 time: 0.318752 Jun 30 18:37:25.373163 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 447/888] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:37:25 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1745 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:37:25.755595 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-79eafda2-4dbd-4827-a18f-33739ac4c98a tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:25.756974 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-79eafda2-4dbd-4827-a18f-33739ac4c98a tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: d718c533-1949-4ce7-a767-bdc51f16293a] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:25.763844 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-79eafda2-4dbd-4827-a18f-33739ac4c98a tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:25.764289 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-79eafda2-4dbd-4827-a18f-33739ac4c98a tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:25.765042 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-79eafda2-4dbd-4827-a18f-33739ac4c98a tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:25.765566 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-79eafda2-4dbd-4827-a18f-33739ac4c98a tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:25.925313 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-79eafda2-4dbd-4827-a18f-33739ac4c98a tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:25.936360 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-79eafda2-4dbd-4827-a18f-33739ac4c98a tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a" status: 200 len: 1266 microversion: 2.1 time: 0.185104 Jun 30 18:37:25.937111 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 442/889] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:37:25 2022] GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:37:26.391491 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-91d61c07-89cb-484d-a87e-23bfcc5881fc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:26.392108 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-91d61c07-89cb-484d-a87e-23bfcc5881fc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:26.398469 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-91d61c07-89cb-484d-a87e-23bfcc5881fc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:26.398911 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-91d61c07-89cb-484d-a87e-23bfcc5881fc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:26.399657 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-91d61c07-89cb-484d-a87e-23bfcc5881fc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:26.400090 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-91d61c07-89cb-484d-a87e-23bfcc5881fc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:26.528701 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-91d61c07-89cb-484d-a87e-23bfcc5881fc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:26.537480 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-91d61c07-89cb-484d-a87e-23bfcc5881fc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:26.539164 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-91d61c07-89cb-484d-a87e-23bfcc5881fc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:26.540331 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-91d61c07-89cb-484d-a87e-23bfcc5881fc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1745 microversion: 2.20 time: 0.152887 Jun 30 18:37:26.540878 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 448/890] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:37:26 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:37:26.961465 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-01b73444-3adc-4bdc-ada9-a61867ce86f3 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:26.962669 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-01b73444-3adc-4bdc-ada9-a61867ce86f3 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: d718c533-1949-4ce7-a767-bdc51f16293a] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:26.969819 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-01b73444-3adc-4bdc-ada9-a61867ce86f3 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:26.969819 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-01b73444-3adc-4bdc-ada9-a61867ce86f3 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:26.970524 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-01b73444-3adc-4bdc-ada9-a61867ce86f3 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:26.971109 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-01b73444-3adc-4bdc-ada9-a61867ce86f3 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:27.108363 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-01b73444-3adc-4bdc-ada9-a61867ce86f3 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:27.116505 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-01b73444-3adc-4bdc-ada9-a61867ce86f3 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a" status: 200 len: 1266 microversion: 2.1 time: 0.166076 Jun 30 18:37:27.117073 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 443/891] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:37:26 2022] GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:37:27.559329 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-fbc1ef8d-3825-4830-9851-d895065114dc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:27.559926 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-fbc1ef8d-3825-4830-9851-d895065114dc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:27.566971 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fbc1ef8d-3825-4830-9851-d895065114dc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:27.567418 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fbc1ef8d-3825-4830-9851-d895065114dc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:27.568173 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fbc1ef8d-3825-4830-9851-d895065114dc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:27.568601 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fbc1ef8d-3825-4830-9851-d895065114dc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:27.697006 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-fbc1ef8d-3825-4830-9851-d895065114dc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:27.704850 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-fbc1ef8d-3825-4830-9851-d895065114dc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:27.706463 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-fbc1ef8d-3825-4830-9851-d895065114dc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:27.707761 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-fbc1ef8d-3825-4830-9851-d895065114dc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1745 microversion: 2.20 time: 0.152299 Jun 30 18:37:27.708314 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 449/892] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:37:27 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:37:28.133007 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-cea17d0d-9073-49ae-8a3f-80e5bca6c74c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:28.133639 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-cea17d0d-9073-49ae-8a3f-80e5bca6c74c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: d718c533-1949-4ce7-a767-bdc51f16293a] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:28.140067 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cea17d0d-9073-49ae-8a3f-80e5bca6c74c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:28.140505 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cea17d0d-9073-49ae-8a3f-80e5bca6c74c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:28.141247 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cea17d0d-9073-49ae-8a3f-80e5bca6c74c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:28.141698 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cea17d0d-9073-49ae-8a3f-80e5bca6c74c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:28.274965 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-cea17d0d-9073-49ae-8a3f-80e5bca6c74c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:28.282316 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-cea17d0d-9073-49ae-8a3f-80e5bca6c74c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a" status: 200 len: 1266 microversion: 2.1 time: 0.153132 Jun 30 18:37:28.282873 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 444/893] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:37:28 2022] GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:37:28.726304 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-ea8e218d-426a-4cd0-b442-0c642e7ee052 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:28.726919 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-ea8e218d-426a-4cd0-b442-0c642e7ee052 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:28.733358 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ea8e218d-426a-4cd0-b442-0c642e7ee052 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:28.733842 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ea8e218d-426a-4cd0-b442-0c642e7ee052 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:28.734597 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ea8e218d-426a-4cd0-b442-0c642e7ee052 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:28.735027 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ea8e218d-426a-4cd0-b442-0c642e7ee052 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:28.752658 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell1:SELECT=100 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:37:28.866307 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-ea8e218d-426a-4cd0-b442-0c642e7ee052 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:28.874163 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-ea8e218d-426a-4cd0-b442-0c642e7ee052 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:28.875651 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-ea8e218d-426a-4cd0-b442-0c642e7ee052 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:28.876800 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-ea8e218d-426a-4cd0-b442-0c642e7ee052 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1745 microversion: 2.20 time: 0.155127 Jun 30 18:37:28.877355 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 450/894] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:37:28 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:37:29.299456 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-3eb74462-28d4-48e2-a26b-7677ccf8729a tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:29.300016 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-3eb74462-28d4-48e2-a26b-7677ccf8729a tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: d718c533-1949-4ce7-a767-bdc51f16293a] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:29.307057 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3eb74462-28d4-48e2-a26b-7677ccf8729a tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:29.307500 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3eb74462-28d4-48e2-a26b-7677ccf8729a tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:29.308244 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3eb74462-28d4-48e2-a26b-7677ccf8729a tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:29.308669 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3eb74462-28d4-48e2-a26b-7677ccf8729a tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:29.439476 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-3eb74462-28d4-48e2-a26b-7677ccf8729a tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:29.447239 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-3eb74462-28d4-48e2-a26b-7677ccf8729a tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a" status: 200 len: 1266 microversion: 2.1 time: 0.151682 Jun 30 18:37:29.447808 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 445/895] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:37:29 2022] GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:37:29.755891 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-c8815f2f-1102-4ad7-b278-cd9496d61f1d req-d1373f60-1b01-48e3-ae7d-ddd571a16273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2c839c4-5e9d-433d-ac94-1d8f3f0875e3", "name": "network-vif-plugged", "status": "completed", "tag": "c81ef70e-10e5-414c-8ee1-71b2bd8320c9"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:37:29.764380 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-c8815f2f-1102-4ad7-b278-cd9496d61f1d req-d1373f60-1b01-48e3-ae7d-ddd571a16273 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:29.764818 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-c8815f2f-1102-4ad7-b278-cd9496d61f1d req-d1373f60-1b01-48e3-ae7d-ddd571a16273 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:29.779114 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.compute.server_external_events [req-c8815f2f-1102-4ad7-b278-cd9496d61f1d req-d1373f60-1b01-48e3-ae7d-ddd571a16273 service nova] Creating event network-vif-plugged:c81ef70e-10e5-414c-8ee1-71b2bd8320c9 for instance a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 on hv-cinder-80378 Jun 30 18:37:29.784035 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-c8815f2f-1102-4ad7-b278-cd9496d61f1d req-d1373f60-1b01-48e3-ae7d-ddd571a16273 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031969 Jun 30 18:37:29.785215 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 451/896] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:37:29.896541 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-3f0c8636-b0c9-4c32-99e1-3ae83e27058d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:29.897061 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-3f0c8636-b0c9-4c32-99e1-3ae83e27058d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:29.903007 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3f0c8636-b0c9-4c32-99e1-3ae83e27058d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:29.903452 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3f0c8636-b0c9-4c32-99e1-3ae83e27058d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:29.904204 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3f0c8636-b0c9-4c32-99e1-3ae83e27058d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:29.904637 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3f0c8636-b0c9-4c32-99e1-3ae83e27058d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:30.039756 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-3f0c8636-b0c9-4c32-99e1-3ae83e27058d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:30.049102 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-3f0c8636-b0c9-4c32-99e1-3ae83e27058d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:30.050748 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-3f0c8636-b0c9-4c32-99e1-3ae83e27058d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:30.051902 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-3f0c8636-b0c9-4c32-99e1-3ae83e27058d tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1745 microversion: 2.20 time: 0.160350 Jun 30 18:37:30.052454 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 446/897] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:37:29 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:37:30.465331 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-f5d87f7a-af1a-4233-ade1-0e76a78cd301 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:30.466083 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-f5d87f7a-af1a-4233-ade1-0e76a78cd301 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: d718c533-1949-4ce7-a767-bdc51f16293a] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:30.472931 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f5d87f7a-af1a-4233-ade1-0e76a78cd301 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:30.473374 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f5d87f7a-af1a-4233-ade1-0e76a78cd301 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:30.474148 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f5d87f7a-af1a-4233-ade1-0e76a78cd301 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:30.474580 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f5d87f7a-af1a-4233-ade1-0e76a78cd301 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:30.605444 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-f5d87f7a-af1a-4233-ade1-0e76a78cd301 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:30.612997 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-f5d87f7a-af1a-4233-ade1-0e76a78cd301 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a" status: 200 len: 1266 microversion: 2.1 time: 0.151968 Jun 30 18:37:30.613556 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 452/898] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:37:30 2022] GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:37:31.073455 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-de02ba01-1d0e-4e27-80c2-fb3fea77c504 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:31.074128 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-de02ba01-1d0e-4e27-80c2-fb3fea77c504 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:31.080828 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-de02ba01-1d0e-4e27-80c2-fb3fea77c504 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:31.081308 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-de02ba01-1d0e-4e27-80c2-fb3fea77c504 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:31.082808 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-de02ba01-1d0e-4e27-80c2-fb3fea77c504 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:31.083447 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-de02ba01-1d0e-4e27-80c2-fb3fea77c504 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:31.088606 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell1:SELECT=100 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:37:31.223867 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-de02ba01-1d0e-4e27-80c2-fb3fea77c504 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:31.231751 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-de02ba01-1d0e-4e27-80c2-fb3fea77c504 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:31.233250 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-de02ba01-1d0e-4e27-80c2-fb3fea77c504 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:31.234435 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-de02ba01-1d0e-4e27-80c2-fb3fea77c504 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1745 microversion: 2.20 time: 0.164949 Jun 30 18:37:31.234995 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 447/899] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:37:31 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1745 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:37:31.630140 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-d2794949-50ef-4f23-8ea8-22d706cc2b9f tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:31.630742 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-d2794949-50ef-4f23-8ea8-22d706cc2b9f tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: d718c533-1949-4ce7-a767-bdc51f16293a] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:31.638937 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d2794949-50ef-4f23-8ea8-22d706cc2b9f tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:31.639371 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d2794949-50ef-4f23-8ea8-22d706cc2b9f tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:31.640137 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d2794949-50ef-4f23-8ea8-22d706cc2b9f tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:31.640561 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d2794949-50ef-4f23-8ea8-22d706cc2b9f tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:31.782621 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-d2794949-50ef-4f23-8ea8-22d706cc2b9f tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:31.791298 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-d2794949-50ef-4f23-8ea8-22d706cc2b9f tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a" status: 200 len: 1266 microversion: 2.1 time: 0.165448 Jun 30 18:37:31.792078 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 453/900] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:37:31 2022] GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:37:32.255682 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-c7bfec50-7cbc-4e36-9aec-3a7d9e6ab379 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:32.261489 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-c7bfec50-7cbc-4e36-9aec-3a7d9e6ab379 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:32.267677 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c7bfec50-7cbc-4e36-9aec-3a7d9e6ab379 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:32.268124 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c7bfec50-7cbc-4e36-9aec-3a7d9e6ab379 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:32.269785 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c7bfec50-7cbc-4e36-9aec-3a7d9e6ab379 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:32.270059 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c7bfec50-7cbc-4e36-9aec-3a7d9e6ab379 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:32.402981 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-c7bfec50-7cbc-4e36-9aec-3a7d9e6ab379 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:32.411146 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-c7bfec50-7cbc-4e36-9aec-3a7d9e6ab379 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:32.412646 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-c7bfec50-7cbc-4e36-9aec-3a7d9e6ab379 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:32.413827 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-c7bfec50-7cbc-4e36-9aec-3a7d9e6ab379 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1745 microversion: 2.20 time: 0.164535 Jun 30 18:37:32.414389 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 448/901] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:37:32 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:37:32.809351 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-53131465-6516-4802-a42d-25a6730aab5d tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:32.809999 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-53131465-6516-4802-a42d-25a6730aab5d tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: d718c533-1949-4ce7-a767-bdc51f16293a] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:32.817726 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-53131465-6516-4802-a42d-25a6730aab5d tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:32.818170 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-53131465-6516-4802-a42d-25a6730aab5d tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:32.818925 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-53131465-6516-4802-a42d-25a6730aab5d tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:32.819358 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-53131465-6516-4802-a42d-25a6730aab5d tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:32.951872 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-53131465-6516-4802-a42d-25a6730aab5d tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:32.959328 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-53131465-6516-4802-a42d-25a6730aab5d tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a" status: 200 len: 1266 microversion: 2.1 time: 0.154715 Jun 30 18:37:32.959886 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 454/902] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:37:32 2022] GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:37:33.431727 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-7e932cb2-4076-4e5f-9d5d-32f0a006a728 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:33.432367 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-7e932cb2-4076-4e5f-9d5d-32f0a006a728 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:33.439177 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7e932cb2-4076-4e5f-9d5d-32f0a006a728 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:33.439624 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7e932cb2-4076-4e5f-9d5d-32f0a006a728 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:33.440408 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7e932cb2-4076-4e5f-9d5d-32f0a006a728 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:33.440876 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7e932cb2-4076-4e5f-9d5d-32f0a006a728 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:33.568355 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-7e932cb2-4076-4e5f-9d5d-32f0a006a728 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:33.576188 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-7e932cb2-4076-4e5f-9d5d-32f0a006a728 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:33.577754 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-7e932cb2-4076-4e5f-9d5d-32f0a006a728 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:33.578940 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-7e932cb2-4076-4e5f-9d5d-32f0a006a728 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1745 microversion: 2.20 time: 0.151174 Jun 30 18:37:33.579500 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 449/903] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:37:33 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:37:33.976393 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-cfc73153-10f2-4272-9cba-bd752b5e78e8 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:33.976997 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-cfc73153-10f2-4272-9cba-bd752b5e78e8 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: d718c533-1949-4ce7-a767-bdc51f16293a] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:33.983471 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-cfc73153-10f2-4272-9cba-bd752b5e78e8 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:33.983915 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-cfc73153-10f2-4272-9cba-bd752b5e78e8 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:33.984671 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-cfc73153-10f2-4272-9cba-bd752b5e78e8 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:33.985100 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-cfc73153-10f2-4272-9cba-bd752b5e78e8 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:34.121222 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-cfc73153-10f2-4272-9cba-bd752b5e78e8 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:34.129142 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-cfc73153-10f2-4272-9cba-bd752b5e78e8 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a" status: 200 len: 1266 microversion: 2.1 time: 0.156227 Jun 30 18:37:34.129735 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 455/904] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:37:33 2022] GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:37:34.598698 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-76c5a184-0d4e-404e-a084-328c42d9cc46 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:34.599229 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-76c5a184-0d4e-404e-a084-328c42d9cc46 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:34.606161 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-76c5a184-0d4e-404e-a084-328c42d9cc46 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:34.606609 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-76c5a184-0d4e-404e-a084-328c42d9cc46 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:34.607370 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-76c5a184-0d4e-404e-a084-328c42d9cc46 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:34.607835 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-76c5a184-0d4e-404e-a084-328c42d9cc46 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:34.734709 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-76c5a184-0d4e-404e-a084-328c42d9cc46 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:34.743515 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-76c5a184-0d4e-404e-a084-328c42d9cc46 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:34.745014 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-76c5a184-0d4e-404e-a084-328c42d9cc46 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:34.746203 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-76c5a184-0d4e-404e-a084-328c42d9cc46 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1745 microversion: 2.20 time: 0.151961 Jun 30 18:37:34.746743 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 450/905] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:37:34 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 18:37:35.145864 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-17218f82-952f-4fd1-a29d-fee0d3b3dd4b tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:35.146470 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-17218f82-952f-4fd1-a29d-fee0d3b3dd4b tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: d718c533-1949-4ce7-a767-bdc51f16293a] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:35.152902 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-17218f82-952f-4fd1-a29d-fee0d3b3dd4b tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:35.153342 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-17218f82-952f-4fd1-a29d-fee0d3b3dd4b tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:35.154194 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-17218f82-952f-4fd1-a29d-fee0d3b3dd4b tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:35.154569 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-17218f82-952f-4fd1-a29d-fee0d3b3dd4b tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:35.286071 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-17218f82-952f-4fd1-a29d-fee0d3b3dd4b tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:35.293398 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-17218f82-952f-4fd1-a29d-fee0d3b3dd4b tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a" status: 200 len: 1266 microversion: 2.1 time: 0.151566 Jun 30 18:37:35.294002 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 456/906] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:37:35 2022] GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:37:35.764897 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-cf39aa6e-793e-43bc-8130-35a4f37f4c99 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:35.765497 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-cf39aa6e-793e-43bc-8130-35a4f37f4c99 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:35.772597 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cf39aa6e-793e-43bc-8130-35a4f37f4c99 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:35.773047 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cf39aa6e-793e-43bc-8130-35a4f37f4c99 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:35.773831 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cf39aa6e-793e-43bc-8130-35a4f37f4c99 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:35.774267 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cf39aa6e-793e-43bc-8130-35a4f37f4c99 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:35.901257 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-cf39aa6e-793e-43bc-8130-35a4f37f4c99 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:35.908944 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-cf39aa6e-793e-43bc-8130-35a4f37f4c99 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:35.911133 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-cf39aa6e-793e-43bc-8130-35a4f37f4c99 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:35.912272 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-cf39aa6e-793e-43bc-8130-35a4f37f4c99 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1745 microversion: 2.20 time: 0.151332 Jun 30 18:37:35.912832 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 451/907] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:37:35 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:37:36.310550 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-ac37acfb-c190-486b-bacc-5561a2a3ec7d tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:36.311091 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-ac37acfb-c190-486b-bacc-5561a2a3ec7d tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: d718c533-1949-4ce7-a767-bdc51f16293a] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:36.318013 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ac37acfb-c190-486b-bacc-5561a2a3ec7d tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:36.318452 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ac37acfb-c190-486b-bacc-5561a2a3ec7d tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:36.319196 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ac37acfb-c190-486b-bacc-5561a2a3ec7d tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:36.319654 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ac37acfb-c190-486b-bacc-5561a2a3ec7d tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:36.449165 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-ac37acfb-c190-486b-bacc-5561a2a3ec7d tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:36.456580 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-ac37acfb-c190-486b-bacc-5561a2a3ec7d tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a" status: 200 len: 1266 microversion: 2.1 time: 0.149954 Jun 30 18:37:36.457682 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 457/908] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:37:36 2022] GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:37:36.931402 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-651a2139-9f06-42e4-9fcb-06085bcd3647 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:36.932009 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-651a2139-9f06-42e4-9fcb-06085bcd3647 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:36.938370 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-651a2139-9f06-42e4-9fcb-06085bcd3647 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:36.938809 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-651a2139-9f06-42e4-9fcb-06085bcd3647 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:36.939553 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-651a2139-9f06-42e4-9fcb-06085bcd3647 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:36.939975 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-651a2139-9f06-42e4-9fcb-06085bcd3647 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:37.001339 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-aab3fdcf-2c0d-4471-bd6a-31c07d1340c6 req-4065b805-4a9c-431b-815f-7f5604554c28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d718c533-1949-4ce7-a767-bdc51f16293a", "name": "network-vif-plugged", "status": "completed", "tag": "ba3cd163-a8e4-46d4-ab5e-d19b0f7bd916"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:37:37.010162 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-aab3fdcf-2c0d-4471-bd6a-31c07d1340c6 req-4065b805-4a9c-431b-815f-7f5604554c28 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:37.010582 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-aab3fdcf-2c0d-4471-bd6a-31c07d1340c6 req-4065b805-4a9c-431b-815f-7f5604554c28 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:37.022641 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.compute.server_external_events [req-aab3fdcf-2c0d-4471-bd6a-31c07d1340c6 req-4065b805-4a9c-431b-815f-7f5604554c28 service nova] Creating event network-vif-plugged:ba3cd163-a8e4-46d4-ab5e-d19b0f7bd916 for instance d718c533-1949-4ce7-a767-bdc51f16293a on hv-cinder-80378 Jun 30 18:37:37.028122 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-aab3fdcf-2c0d-4471-bd6a-31c07d1340c6 req-4065b805-4a9c-431b-815f-7f5604554c28 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030284 Jun 30 18:37:37.029262 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 458/909] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:37:37.094863 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-651a2139-9f06-42e4-9fcb-06085bcd3647 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:37.103547 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-651a2139-9f06-42e4-9fcb-06085bcd3647 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:37.105357 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-651a2139-9f06-42e4-9fcb-06085bcd3647 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:37.106581 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-651a2139-9f06-42e4-9fcb-06085bcd3647 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1745 microversion: 2.20 time: 0.179225 Jun 30 18:37:37.107340 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 452/910] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:37:36 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1745 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:37:37.477326 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-56f23393-619d-4699-bbf7-d4906ba6c0fa tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:37.478054 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-56f23393-619d-4699-bbf7-d4906ba6c0fa tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: d718c533-1949-4ce7-a767-bdc51f16293a] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:37.486423 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-56f23393-619d-4699-bbf7-d4906ba6c0fa tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:37.486869 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-56f23393-619d-4699-bbf7-d4906ba6c0fa tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:37.487624 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-56f23393-619d-4699-bbf7-d4906ba6c0fa tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:37.488049 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-56f23393-619d-4699-bbf7-d4906ba6c0fa tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:37.661381 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-56f23393-619d-4699-bbf7-d4906ba6c0fa tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:37.669764 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-56f23393-619d-4699-bbf7-d4906ba6c0fa tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a" status: 200 len: 1266 microversion: 2.1 time: 0.198250 Jun 30 18:37:37.670332 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 459/911] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:37:37 2022] GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:37:38.124526 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-5212dd4c-db7b-46a9-9185-f721dcb627d9 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:38.125287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-5212dd4c-db7b-46a9-9185-f721dcb627d9 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:38.132854 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5212dd4c-db7b-46a9-9185-f721dcb627d9 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:38.133530 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5212dd4c-db7b-46a9-9185-f721dcb627d9 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:38.134558 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5212dd4c-db7b-46a9-9185-f721dcb627d9 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:38.135502 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5212dd4c-db7b-46a9-9185-f721dcb627d9 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:38.315246 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-5212dd4c-db7b-46a9-9185-f721dcb627d9 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:38.325958 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-5212dd4c-db7b-46a9-9185-f721dcb627d9 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:38.328388 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-5212dd4c-db7b-46a9-9185-f721dcb627d9 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:38.329794 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-5212dd4c-db7b-46a9-9185-f721dcb627d9 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1740 microversion: 2.20 time: 0.209146 Jun 30 18:37:38.330542 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 453/912] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:37:38 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1740 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:37:38.686260 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-188fa101-e729-46d9-af3a-e123dd9eaad9 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:38.686882 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-188fa101-e729-46d9-af3a-e123dd9eaad9 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: d718c533-1949-4ce7-a767-bdc51f16293a] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:38.693408 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-188fa101-e729-46d9-af3a-e123dd9eaad9 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:38.693890 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-188fa101-e729-46d9-af3a-e123dd9eaad9 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:38.694828 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-188fa101-e729-46d9-af3a-e123dd9eaad9 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:38.695526 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-188fa101-e729-46d9-af3a-e123dd9eaad9 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:38.854301 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-188fa101-e729-46d9-af3a-e123dd9eaad9 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:38.863349 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-188fa101-e729-46d9-af3a-e123dd9eaad9 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a" status: 200 len: 1266 microversion: 2.1 time: 0.180972 Jun 30 18:37:38.864688 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 460/913] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:37:38 2022] GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:37:39.349533 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-957c9696-e149-4cd0-866a-be85dda1acd3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:39.350886 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-957c9696-e149-4cd0-866a-be85dda1acd3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:39.357791 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-957c9696-e149-4cd0-866a-be85dda1acd3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:39.358233 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-957c9696-e149-4cd0-866a-be85dda1acd3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:39.359042 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-957c9696-e149-4cd0-866a-be85dda1acd3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:39.359743 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-957c9696-e149-4cd0-866a-be85dda1acd3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:39.512987 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-957c9696-e149-4cd0-866a-be85dda1acd3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:39.521539 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-957c9696-e149-4cd0-866a-be85dda1acd3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:39.523070 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-957c9696-e149-4cd0-866a-be85dda1acd3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:39.524445 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-957c9696-e149-4cd0-866a-be85dda1acd3 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1740 microversion: 2.20 time: 0.178870 Jun 30 18:37:39.525222 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 454/914] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:37:39 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1740 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:37:39.880346 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-6957d763-a9a4-4de6-b687-ef62b14e04dc tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:39.881026 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-6957d763-a9a4-4de6-b687-ef62b14e04dc tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: d718c533-1949-4ce7-a767-bdc51f16293a] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:39.887973 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6957d763-a9a4-4de6-b687-ef62b14e04dc tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:39.888411 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6957d763-a9a4-4de6-b687-ef62b14e04dc tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:39.889154 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6957d763-a9a4-4de6-b687-ef62b14e04dc tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:39.889601 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6957d763-a9a4-4de6-b687-ef62b14e04dc tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:40.069190 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-6957d763-a9a4-4de6-b687-ef62b14e04dc tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:40.081475 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-6957d763-a9a4-4de6-b687-ef62b14e04dc tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a" status: 200 len: 1266 microversion: 2.1 time: 0.204941 Jun 30 18:37:40.082570 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 461/915] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:37:39 2022] GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:37:40.544287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-09a88958-3359-4623-a3f8-f0dfaa1c3ed6 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:40.545703 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-09a88958-3359-4623-a3f8-f0dfaa1c3ed6 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:40.553433 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-09a88958-3359-4623-a3f8-f0dfaa1c3ed6 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:40.553994 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-09a88958-3359-4623-a3f8-f0dfaa1c3ed6 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:40.554857 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-09a88958-3359-4623-a3f8-f0dfaa1c3ed6 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:40.555372 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-09a88958-3359-4623-a3f8-f0dfaa1c3ed6 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:40.698334 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-09a88958-3359-4623-a3f8-f0dfaa1c3ed6 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:40.707616 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-09a88958-3359-4623-a3f8-f0dfaa1c3ed6 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:40.711393 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-09a88958-3359-4623-a3f8-f0dfaa1c3ed6 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:40.713402 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-09a88958-3359-4623-a3f8-f0dfaa1c3ed6 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1740 microversion: 2.20 time: 0.173903 Jun 30 18:37:40.713987 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 455/916] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:37:40 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:37:41.105595 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-021e51af-5503-45fd-bdc6-452f97cafdca tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:41.106215 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-021e51af-5503-45fd-bdc6-452f97cafdca tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: d718c533-1949-4ce7-a767-bdc51f16293a] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:41.112975 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-021e51af-5503-45fd-bdc6-452f97cafdca tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:41.113450 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-021e51af-5503-45fd-bdc6-452f97cafdca tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:41.114354 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-021e51af-5503-45fd-bdc6-452f97cafdca tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:41.115133 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-021e51af-5503-45fd-bdc6-452f97cafdca tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:41.269541 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-021e51af-5503-45fd-bdc6-452f97cafdca tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:41.279013 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-021e51af-5503-45fd-bdc6-452f97cafdca tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a" status: 200 len: 1452 microversion: 2.1 time: 0.177287 Jun 30 18:37:41.279577 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 462/917] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:37:41 2022] GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a => generated 1452 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:37:41.295986 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-d5e0f2ea-7c23-446f-ac59-202fa62720a3 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:41.296712 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-d5e0f2ea-7c23-446f-ac59-202fa62720a3 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: d718c533-1949-4ce7-a767-bdc51f16293a] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:41.303083 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d5e0f2ea-7c23-446f-ac59-202fa62720a3 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:41.303522 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d5e0f2ea-7c23-446f-ac59-202fa62720a3 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:41.304303 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d5e0f2ea-7c23-446f-ac59-202fa62720a3 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:41.304725 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d5e0f2ea-7c23-446f-ac59-202fa62720a3 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:41.501076 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-d5e0f2ea-7c23-446f-ac59-202fa62720a3 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:41.511149 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-d5e0f2ea-7c23-446f-ac59-202fa62720a3 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a" status: 200 len: 1452 microversion: 2.1 time: 0.218332 Jun 30 18:37:41.512335 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 456/918] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:37:41 2022] GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a => generated 1452 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:37:41.733730 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-a7cffd37-6c7e-4818-9b6f-a259a62b1e11 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:41.734603 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-a7cffd37-6c7e-4818-9b6f-a259a62b1e11 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:41.741857 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a7cffd37-6c7e-4818-9b6f-a259a62b1e11 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:41.742511 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a7cffd37-6c7e-4818-9b6f-a259a62b1e11 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:41.743521 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a7cffd37-6c7e-4818-9b6f-a259a62b1e11 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:41.744195 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a7cffd37-6c7e-4818-9b6f-a259a62b1e11 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:41.978923 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-a7cffd37-6c7e-4818-9b6f-a259a62b1e11 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:41.988779 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-a7cffd37-6c7e-4818-9b6f-a259a62b1e11 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:41.991401 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-a7cffd37-6c7e-4818-9b6f-a259a62b1e11 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:41.992910 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-a7cffd37-6c7e-4818-9b6f-a259a62b1e11 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1740 microversion: 2.20 time: 0.264321 Jun 30 18:37:41.993830 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 463/919] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:37:41 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1740 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:37:43.014366 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-550ba889-8920-4c17-bb2e-37a06a0c9302 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:43.015041 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-550ba889-8920-4c17-bb2e-37a06a0c9302 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:43.023792 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-550ba889-8920-4c17-bb2e-37a06a0c9302 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:43.024326 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-550ba889-8920-4c17-bb2e-37a06a0c9302 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:43.025167 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-550ba889-8920-4c17-bb2e-37a06a0c9302 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:43.025695 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-550ba889-8920-4c17-bb2e-37a06a0c9302 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:43.634841 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-550ba889-8920-4c17-bb2e-37a06a0c9302 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:43.644945 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-550ba889-8920-4c17-bb2e-37a06a0c9302 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:43.648873 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-550ba889-8920-4c17-bb2e-37a06a0c9302 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:43.654670 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-550ba889-8920-4c17-bb2e-37a06a0c9302 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1740 microversion: 2.20 time: 0.646434 Jun 30 18:37:43.657211 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 457/920] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:37:43 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1740 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:37:44.028350 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-dba62cf2-ffdf-4235-8ac9-255a12f459c7 req-9f30578c-7a38-4fc5-9725-67a033938c6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d718c533-1949-4ce7-a767-bdc51f16293a", "tag": "ba3cd163-a8e4-46d4-ab5e-d19b0f7bd916"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:37:44.042328 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-dba62cf2-ffdf-4235-8ac9-255a12f459c7 req-9f30578c-7a38-4fc5-9725-67a033938c6b service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:44.046909 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-dba62cf2-ffdf-4235-8ac9-255a12f459c7 req-9f30578c-7a38-4fc5-9725-67a033938c6b service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:44.080557 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.compute.server_external_events [req-dba62cf2-ffdf-4235-8ac9-255a12f459c7 req-9f30578c-7a38-4fc5-9725-67a033938c6b service nova] Creating event network-changed:ba3cd163-a8e4-46d4-ab5e-d19b0f7bd916 for instance d718c533-1949-4ce7-a767-bdc51f16293a on hv-cinder-80378 Jun 30 18:37:44.090339 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-dba62cf2-ffdf-4235-8ac9-255a12f459c7 req-9f30578c-7a38-4fc5-9725-67a033938c6b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070697 Jun 30 18:37:44.091723 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 464/921] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:37:44.675252 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-ab9c6bf5-f537-42c6-b505-5e888d76570b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:44.676006 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-ab9c6bf5-f537-42c6-b505-5e888d76570b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:44.682391 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ab9c6bf5-f537-42c6-b505-5e888d76570b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:44.683827 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ab9c6bf5-f537-42c6-b505-5e888d76570b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:44.686513 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ab9c6bf5-f537-42c6-b505-5e888d76570b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:44.691681 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-ab9c6bf5-f537-42c6-b505-5e888d76570b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:44.980756 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-ab9c6bf5-f537-42c6-b505-5e888d76570b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:45.004359 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-ab9c6bf5-f537-42c6-b505-5e888d76570b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:45.007687 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-ab9c6bf5-f537-42c6-b505-5e888d76570b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:45.008963 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-ab9c6bf5-f537-42c6-b505-5e888d76570b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1740 microversion: 2.20 time: 0.338417 Jun 30 18:37:45.012819 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 458/922] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:37:44 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1740 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:37:46.034386 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-dd8b2398-cda0-4a2f-9e3c-356b9eaa9dce tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:46.035645 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-dd8b2398-cda0-4a2f-9e3c-356b9eaa9dce tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:46.044136 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-dd8b2398-cda0-4a2f-9e3c-356b9eaa9dce tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:46.044843 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-dd8b2398-cda0-4a2f-9e3c-356b9eaa9dce tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:46.046424 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-dd8b2398-cda0-4a2f-9e3c-356b9eaa9dce tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:46.047173 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-dd8b2398-cda0-4a2f-9e3c-356b9eaa9dce tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:46.344112 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-dd8b2398-cda0-4a2f-9e3c-356b9eaa9dce tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:46.361749 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-dd8b2398-cda0-4a2f-9e3c-356b9eaa9dce tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:46.380814 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-dd8b2398-cda0-4a2f-9e3c-356b9eaa9dce tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:46.383209 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-dd8b2398-cda0-4a2f-9e3c-356b9eaa9dce tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1740 microversion: 2.20 time: 0.354883 Jun 30 18:37:46.399942 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 465/923] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:37:46 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1740 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:37:47.407546 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-5962f5b3-95d8-4955-96e2-1122022a220b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:47.412987 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-5962f5b3-95d8-4955-96e2-1122022a220b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:47.419288 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5962f5b3-95d8-4955-96e2-1122022a220b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:47.422584 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5962f5b3-95d8-4955-96e2-1122022a220b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:47.423607 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5962f5b3-95d8-4955-96e2-1122022a220b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:47.424213 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5962f5b3-95d8-4955-96e2-1122022a220b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:47.622461 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-5962f5b3-95d8-4955-96e2-1122022a220b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:47.635872 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-5962f5b3-95d8-4955-96e2-1122022a220b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:47.638588 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-5962f5b3-95d8-4955-96e2-1122022a220b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:47.640054 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-5962f5b3-95d8-4955-96e2-1122022a220b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1740 microversion: 2.20 time: 0.236901 Jun 30 18:37:47.640763 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 459/924] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:37:47 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1740 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:37:48.685266 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-b0245e0b-800b-491b-aa21-2a463d844abf tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:48.686321 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-b0245e0b-800b-491b-aa21-2a463d844abf tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:48.710899 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b0245e0b-800b-491b-aa21-2a463d844abf tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:48.711555 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b0245e0b-800b-491b-aa21-2a463d844abf tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:48.713706 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b0245e0b-800b-491b-aa21-2a463d844abf tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:48.714309 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b0245e0b-800b-491b-aa21-2a463d844abf tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:48.901305 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-b0245e0b-800b-491b-aa21-2a463d844abf tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:48.916495 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-b0245e0b-800b-491b-aa21-2a463d844abf tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:48.918099 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-b0245e0b-800b-491b-aa21-2a463d844abf tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:48.921843 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-b0245e0b-800b-491b-aa21-2a463d844abf tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1740 microversion: 2.20 time: 0.241104 Jun 30 18:37:48.924452 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 466/925] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:37:48 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1740 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:37:49.943343 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-8703fd08-73ed-4408-8feb-d92e4bb8815c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:49.944026 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-8703fd08-73ed-4408-8feb-d92e4bb8815c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:49.953949 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8703fd08-73ed-4408-8feb-d92e4bb8815c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:49.954400 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8703fd08-73ed-4408-8feb-d92e4bb8815c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:49.960647 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8703fd08-73ed-4408-8feb-d92e4bb8815c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:49.961107 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8703fd08-73ed-4408-8feb-d92e4bb8815c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:50.122251 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-8703fd08-73ed-4408-8feb-d92e4bb8815c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:50.131219 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-8703fd08-73ed-4408-8feb-d92e4bb8815c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:50.133523 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-8703fd08-73ed-4408-8feb-d92e4bb8815c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:50.135495 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-8703fd08-73ed-4408-8feb-d92e4bb8815c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1740 microversion: 2.20 time: 0.196644 Jun 30 18:37:50.136061 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 460/926] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:37:49 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1740 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:37:51.153924 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-a3e37215-965d-4d36-a00f-7a6c6013e8e6 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:51.154524 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-a3e37215-965d-4d36-a00f-7a6c6013e8e6 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:51.166107 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a3e37215-965d-4d36-a00f-7a6c6013e8e6 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:51.166871 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a3e37215-965d-4d36-a00f-7a6c6013e8e6 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:51.168884 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a3e37215-965d-4d36-a00f-7a6c6013e8e6 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:51.172051 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a3e37215-965d-4d36-a00f-7a6c6013e8e6 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:51.433915 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-a3e37215-965d-4d36-a00f-7a6c6013e8e6 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:51.449700 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-a3e37215-965d-4d36-a00f-7a6c6013e8e6 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:51.451466 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-a3e37215-965d-4d36-a00f-7a6c6013e8e6 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:51.452624 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-a3e37215-965d-4d36-a00f-7a6c6013e8e6 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1722 microversion: 2.20 time: 0.302946 Jun 30 18:37:51.453482 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 467/927] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:37:51 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1722 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:37:52.472721 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-c963981c-f7e3-4738-9bcd-de0ab62e540e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:52.473322 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-c963981c-f7e3-4738-9bcd-de0ab62e540e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:52.476029 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_api:SELECT=44 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:37:52.481468 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c963981c-f7e3-4738-9bcd-de0ab62e540e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:52.482118 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c963981c-f7e3-4738-9bcd-de0ab62e540e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:52.483309 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c963981c-f7e3-4738-9bcd-de0ab62e540e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:52.484075 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c963981c-f7e3-4738-9bcd-de0ab62e540e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:52.747746 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-c963981c-f7e3-4738-9bcd-de0ab62e540e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:52.759708 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-c963981c-f7e3-4738-9bcd-de0ab62e540e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:52.763233 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-c963981c-f7e3-4738-9bcd-de0ab62e540e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:52.764703 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-c963981c-f7e3-4738-9bcd-de0ab62e540e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1722 microversion: 2.20 time: 0.295915 Jun 30 18:37:52.765936 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 461/928] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:37:52 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1722 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:37:53.784003 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-b1f378e0-c511-4ccf-a9b2-5d5e62b628c9 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:53.785258 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-b1f378e0-c511-4ccf-a9b2-5d5e62b628c9 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:53.792925 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_api:SELECT=46 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:37:53.795666 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b1f378e0-c511-4ccf-a9b2-5d5e62b628c9 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:53.796326 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b1f378e0-c511-4ccf-a9b2-5d5e62b628c9 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:53.797344 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b1f378e0-c511-4ccf-a9b2-5d5e62b628c9 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:53.798021 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b1f378e0-c511-4ccf-a9b2-5d5e62b628c9 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:53.997691 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-b1f378e0-c511-4ccf-a9b2-5d5e62b628c9 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:54.023382 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-b1f378e0-c511-4ccf-a9b2-5d5e62b628c9 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:54.024997 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-b1f378e0-c511-4ccf-a9b2-5d5e62b628c9 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:54.026795 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-b1f378e0-c511-4ccf-a9b2-5d5e62b628c9 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1725 microversion: 2.20 time: 0.247114 Jun 30 18:37:54.029270 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 468/929] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:37:53 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1725 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:37:54.048779 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-453cce66-dce6-4a72-982b-0ef7d8bbf65a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "945a2d7f-045b-4edf-87e6-1fd01495eb97"}} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:37:54.050628 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-453cce66-dce6-4a72-982b-0ef7d8bbf65a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:54.061037 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-453cce66-dce6-4a72-982b-0ef7d8bbf65a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:54.061765 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-453cce66-dce6-4a72-982b-0ef7d8bbf65a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:54.062726 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-453cce66-dce6-4a72-982b-0ef7d8bbf65a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:54.063314 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-453cce66-dce6-4a72-982b-0ef7d8bbf65a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:54.343830 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:37:54.516146 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-453cce66-dce6-4a72-982b-0ef7d8bbf65a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "POST /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.471474 Jun 30 18:37:54.517862 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 462/930] 10.222.0.33 () {62 vars in 1363 bytes} [Thu Jun 30 18:37:54 2022] POST /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3/os-volume_attachments => generated 188 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 18:37:54.691127 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-45190dcd-1372-4a35-b327-9beaf0b12773 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:54.691932 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-45190dcd-1372-4a35-b327-9beaf0b12773 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:54.699420 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-45190dcd-1372-4a35-b327-9beaf0b12773 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:54.700248 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-45190dcd-1372-4a35-b327-9beaf0b12773 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:54.701108 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-45190dcd-1372-4a35-b327-9beaf0b12773 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:54.701666 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-45190dcd-1372-4a35-b327-9beaf0b12773 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:54.705883 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell1:SELECT=100 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:37:55.093100 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-45190dcd-1372-4a35-b327-9beaf0b12773 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3/os-volume_attachments/945a2d7f-045b-4edf-87e6-1fd01495eb97" status: 202 len: 0 microversion: 2.20 time: 0.405503 Jun 30 18:37:55.094497 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 469/931] 10.222.0.33 () {60 vars in 1456 bytes} [Thu Jun 30 18:37:54 2022] DELETE /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3/os-volume_attachments/945a2d7f-045b-4edf-87e6-1fd01495eb97 => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 30 18:37:55.159278 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-7f2442db-f7e7-4b82-b0fb-e4a0fdaada16 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:37:55.160447 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-7f2442db-f7e7-4b82-b0fb-e4a0fdaada16 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:55.168028 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7f2442db-f7e7-4b82-b0fb-e4a0fdaada16 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:55.168553 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7f2442db-f7e7-4b82-b0fb-e4a0fdaada16 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:55.169382 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7f2442db-f7e7-4b82-b0fb-e4a0fdaada16 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:55.169897 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7f2442db-f7e7-4b82-b0fb-e4a0fdaada16 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:55.255020 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-7f2442db-f7e7-4b82-b0fb-e4a0fdaada16 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "POST /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3/action" status: 202 len: 0 microversion: 2.20 time: 0.098094 Jun 30 18:37:55.257034 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 463/932] 10.222.0.33 () {62 vars in 1318 bytes} [Thu Jun 30 18:37:55 2022] POST /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 30 18:37:55.266306 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-37a44a69-baa6-481d-9538-12dc3ded0ad9 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:55.272982 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-37a44a69-baa6-481d-9538-12dc3ded0ad9 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:55.286162 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-37a44a69-baa6-481d-9538-12dc3ded0ad9 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:55.286752 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-37a44a69-baa6-481d-9538-12dc3ded0ad9 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:55.287921 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-37a44a69-baa6-481d-9538-12dc3ded0ad9 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:55.291389 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-37a44a69-baa6-481d-9538-12dc3ded0ad9 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:55.344529 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [req-78a12c17-dc60-4d11-a59f-2f5ac0ccda8e req-3409fb2e-8eb3-4324-bcb7-a84a35bd37d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2c839c4-5e9d-433d-ac94-1d8f3f0875e3", "name": "network-vif-unplugged", "status": "completed", "tag": "c81ef70e-10e5-414c-8ee1-71b2bd8320c9"}]} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:37:55.356400 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-78a12c17-dc60-4d11-a59f-2f5ac0ccda8e req-3409fb2e-8eb3-4324-bcb7-a84a35bd37d8 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:55.356400 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-78a12c17-dc60-4d11-a59f-2f5ac0ccda8e req-3409fb2e-8eb3-4324-bcb7-a84a35bd37d8 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:55.384271 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.compute.server_external_events [req-78a12c17-dc60-4d11-a59f-2f5ac0ccda8e req-3409fb2e-8eb3-4324-bcb7-a84a35bd37d8 service nova] Unable to find a host for instance a2c839c4-5e9d-433d-ac94-1d8f3f0875e3. Dropping event network-vif-unplugged {{(pid=117940) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 30 18:37:55.385357 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [req-78a12c17-dc60-4d11-a59f-2f5ac0ccda8e req-3409fb2e-8eb3-4324-bcb7-a84a35bd37d8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.045408 Jun 30 18:37:55.387176 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 464/933] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 48 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 30 18:37:55.539355 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-37a44a69-baa6-481d-9538-12dc3ded0ad9 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:55.547980 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-37a44a69-baa6-481d-9538-12dc3ded0ad9 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:55.549498 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-37a44a69-baa6-481d-9538-12dc3ded0ad9 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:55.551001 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-37a44a69-baa6-481d-9538-12dc3ded0ad9 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1673 microversion: 2.20 time: 0.289588 Jun 30 18:37:55.559567 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 470/934] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:37:55 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1673 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:37:56.578720 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-4f07144f-c03c-44c8-a3f6-e86c9ab781d0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:56.579480 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-4f07144f-c03c-44c8-a3f6-e86c9ab781d0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:56.589621 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-4f07144f-c03c-44c8-a3f6-e86c9ab781d0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:56.590427 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-4f07144f-c03c-44c8-a3f6-e86c9ab781d0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:56.591483 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-4f07144f-c03c-44c8-a3f6-e86c9ab781d0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:56.592088 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-4f07144f-c03c-44c8-a3f6-e86c9ab781d0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:56.806888 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-4f07144f-c03c-44c8-a3f6-e86c9ab781d0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:56.817368 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-4f07144f-c03c-44c8-a3f6-e86c9ab781d0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:56.821431 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-4f07144f-c03c-44c8-a3f6-e86c9ab781d0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:56.822691 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-4f07144f-c03c-44c8-a3f6-e86c9ab781d0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1673 microversion: 2.20 time: 0.248176 Jun 30 18:37:56.823254 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 465/935] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:37:56 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1673 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:37:57.844722 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-80b88bcc-3e94-42d6-bfc6-91ba324396bc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:57.845293 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-80b88bcc-3e94-42d6-bfc6-91ba324396bc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:57.856675 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-80b88bcc-3e94-42d6-bfc6-91ba324396bc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:57.857392 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-80b88bcc-3e94-42d6-bfc6-91ba324396bc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:57.858379 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-80b88bcc-3e94-42d6-bfc6-91ba324396bc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:57.858965 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-80b88bcc-3e94-42d6-bfc6-91ba324396bc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:58.018575 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-80b88bcc-3e94-42d6-bfc6-91ba324396bc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:58.031311 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-80b88bcc-3e94-42d6-bfc6-91ba324396bc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:58.033013 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-80b88bcc-3e94-42d6-bfc6-91ba324396bc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:58.034419 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-80b88bcc-3e94-42d6-bfc6-91ba324396bc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1731 microversion: 2.20 time: 0.194737 Jun 30 18:37:58.035558 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 471/936] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:37:57 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1731 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:37:59.057255 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-f0ecd9ac-149d-4efa-9389-166979ea937b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:37:59.058844 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-f0ecd9ac-149d-4efa-9389-166979ea937b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:37:59.079018 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f0ecd9ac-149d-4efa-9389-166979ea937b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:59.079896 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f0ecd9ac-149d-4efa-9389-166979ea937b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:59.080937 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f0ecd9ac-149d-4efa-9389-166979ea937b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:37:59.081640 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f0ecd9ac-149d-4efa-9389-166979ea937b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:37:59.521627 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-f0ecd9ac-149d-4efa-9389-166979ea937b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:59.541460 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-f0ecd9ac-149d-4efa-9389-166979ea937b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:59.543207 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-f0ecd9ac-149d-4efa-9389-166979ea937b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:37:59.547922 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-f0ecd9ac-149d-4efa-9389-166979ea937b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1731 microversion: 2.20 time: 0.498059 Jun 30 18:37:59.553835 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 466/937] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:37:59 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1731 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:38:00.571973 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-602bd1af-a76e-4290-a439-ef45519ac6df tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:00.573316 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-602bd1af-a76e-4290-a439-ef45519ac6df tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:00.590393 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-602bd1af-a76e-4290-a439-ef45519ac6df tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:00.591061 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-602bd1af-a76e-4290-a439-ef45519ac6df tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:00.592220 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-602bd1af-a76e-4290-a439-ef45519ac6df tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:00.592773 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-602bd1af-a76e-4290-a439-ef45519ac6df tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:00.912621 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-602bd1af-a76e-4290-a439-ef45519ac6df tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:00.935885 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-602bd1af-a76e-4290-a439-ef45519ac6df tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:00.937743 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-602bd1af-a76e-4290-a439-ef45519ac6df tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:00.942469 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-602bd1af-a76e-4290-a439-ef45519ac6df tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1731 microversion: 2.20 time: 0.375096 Jun 30 18:38:00.948759 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 472/938] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:38:00 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1731 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:38:01.963912 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-e72e9653-d685-4216-ba90-ffc8377d997f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:01.967022 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-e72e9653-d685-4216-ba90-ffc8377d997f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:01.991779 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e72e9653-d685-4216-ba90-ffc8377d997f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:01.994223 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e72e9653-d685-4216-ba90-ffc8377d997f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:01.997837 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e72e9653-d685-4216-ba90-ffc8377d997f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:02.000298 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e72e9653-d685-4216-ba90-ffc8377d997f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:02.309725 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-e72e9653-d685-4216-ba90-ffc8377d997f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:02.319566 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-e72e9653-d685-4216-ba90-ffc8377d997f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:02.321301 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-e72e9653-d685-4216-ba90-ffc8377d997f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:02.322727 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-e72e9653-d685-4216-ba90-ffc8377d997f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1731 microversion: 2.20 time: 0.362812 Jun 30 18:38:02.323478 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 467/939] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:38:01 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1731 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:38:03.358492 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-33cec870-9a51-4443-9dc9-562c9c7b044f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:03.359185 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-33cec870-9a51-4443-9dc9-562c9c7b044f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:03.384735 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-33cec870-9a51-4443-9dc9-562c9c7b044f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:03.385481 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-33cec870-9a51-4443-9dc9-562c9c7b044f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:03.386477 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-33cec870-9a51-4443-9dc9-562c9c7b044f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:03.386916 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-33cec870-9a51-4443-9dc9-562c9c7b044f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:03.612343 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-33cec870-9a51-4443-9dc9-562c9c7b044f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:03.621009 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-33cec870-9a51-4443-9dc9-562c9c7b044f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:03.622531 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-33cec870-9a51-4443-9dc9-562c9c7b044f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:03.623707 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-33cec870-9a51-4443-9dc9-562c9c7b044f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1731 microversion: 2.20 time: 0.278052 Jun 30 18:38:03.624269 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 473/940] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:38:03 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1731 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:38:04.642764 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-20bf3117-d6ba-4ac3-8578-80ecfb5b84dc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:04.644455 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-20bf3117-d6ba-4ac3-8578-80ecfb5b84dc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:04.654251 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-20bf3117-d6ba-4ac3-8578-80ecfb5b84dc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:04.655087 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-20bf3117-d6ba-4ac3-8578-80ecfb5b84dc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:04.656110 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-20bf3117-d6ba-4ac3-8578-80ecfb5b84dc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:04.656762 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-20bf3117-d6ba-4ac3-8578-80ecfb5b84dc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:04.823820 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-20bf3117-d6ba-4ac3-8578-80ecfb5b84dc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:04.832931 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-20bf3117-d6ba-4ac3-8578-80ecfb5b84dc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:04.835874 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-20bf3117-d6ba-4ac3-8578-80ecfb5b84dc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:04.837530 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-20bf3117-d6ba-4ac3-8578-80ecfb5b84dc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1731 microversion: 2.20 time: 0.198705 Jun 30 18:38:04.849078 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 468/941] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:38:04 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1731 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:38:05.856338 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-7e91d08b-bd4f-4137-b4dc-52e210dc65d0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:05.857773 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-7e91d08b-bd4f-4137-b4dc-52e210dc65d0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:05.876425 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7e91d08b-bd4f-4137-b4dc-52e210dc65d0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:05.877165 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7e91d08b-bd4f-4137-b4dc-52e210dc65d0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:05.878203 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7e91d08b-bd4f-4137-b4dc-52e210dc65d0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:05.878790 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7e91d08b-bd4f-4137-b4dc-52e210dc65d0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:06.073117 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-7e91d08b-bd4f-4137-b4dc-52e210dc65d0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:06.087658 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-7e91d08b-bd4f-4137-b4dc-52e210dc65d0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:06.095136 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-7e91d08b-bd4f-4137-b4dc-52e210dc65d0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:06.096620 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-7e91d08b-bd4f-4137-b4dc-52e210dc65d0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1731 microversion: 2.20 time: 0.244102 Jun 30 18:38:06.109223 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 474/942] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:38:05 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1731 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:38:07.092452 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-e4e97260-9b13-4f29-ba48-86b6cd860f25 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Action: 'create', calling method: .version_select at 0x7f1804b041f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1711441821", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMy650w7glLfTkzM5SxXcXq5cNTr+26ZWpBo7R/F27UiwoMnU3Gh6niwgcLguUXaJ4TXBjd/z8x8mYZlHviqwJVmCa1CeE2IzrbdYCbgbgavJuyvtQV7zd1Zj29bhy25sQ=="}} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:38:07.107605 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.quota [None req-e4e97260-9b13-4f29-ba48-86b6cd860f25 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Getting quotas for project 666edd3825ba4e32ac180ed230d93e85. Resources: {'key_pairs'} {{(pid=117940) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 18:38:07.112795 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.quota [None req-e4e97260-9b13-4f29-ba48-86b6cd860f25 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Getting quotas for user 784fdfd56b3d4ae4b6f68b66c4f06ea5 and project 666edd3825ba4e32ac180ed230d93e85. Resources: {'key_pairs'} {{(pid=117940) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 18:38:07.114691 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-d02895eb-3370-41e3-8857-6bf7a0e3e0be tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:07.116367 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-d02895eb-3370-41e3-8857-6bf7a0e3e0be tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:07.122398 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d02895eb-3370-41e3-8857-6bf7a0e3e0be tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:07.122848 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d02895eb-3370-41e3-8857-6bf7a0e3e0be tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:07.123924 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d02895eb-3370-41e3-8857-6bf7a0e3e0be tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:07.124362 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d02895eb-3370-41e3-8857-6bf7a0e3e0be tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:07.144028 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-e4e97260-9b13-4f29-ba48-86b6cd860f25 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.055670 Jun 30 18:38:07.145238 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 469/943] 10.222.0.33 () {60 vars in 1158 bytes} [Thu Jun 30 18:38:07 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:38:07.204773 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-877f43d6-e021-48f7-a48f-38dc48bd0eee tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-260972516", "imageRef": "1da8585e-6dd6-458d-aa4d-047689501f3b", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1711441821", "networks": [{"uuid": "a36b01a6-2646-440a-bc3c-216bd49fd2ff"}]}} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:38:07.280731 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.network.neutron [None req-877f43d6-e021-48f7-a48f-38dc48bd0eee tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] validate_networks() for [('a36b01a6-2646-440a-bc3c-216bd49fd2ff', None, None, None, None, None)] {{(pid=117940) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 18:38:07.321367 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-d02895eb-3370-41e3-8857-6bf7a0e3e0be tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:07.329690 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-d02895eb-3370-41e3-8857-6bf7a0e3e0be tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:07.331237 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-d02895eb-3370-41e3-8857-6bf7a0e3e0be tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:07.332623 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-d02895eb-3370-41e3-8857-6bf7a0e3e0be tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1731 microversion: 2.20 time: 0.222018 Jun 30 18:38:07.344031 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 475/944] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:38:07 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1731 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 18:38:07.701781 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-877f43d6-e021-48f7-a48f-38dc48bd0eee tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Flavor limits 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 18:38:07.702204 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-877f43d6-e021-48f7-a48f-38dc48bd0eee tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Image limits 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 18:38:07.702710 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-877f43d6-e021-48f7-a48f-38dc48bd0eee tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Flavor pref 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 18:38:07.703117 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-877f43d6-e021-48f7-a48f-38dc48bd0eee tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Image pref 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 18:38:07.703527 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-877f43d6-e021-48f7-a48f-38dc48bd0eee tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 18:38:07.712984 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-877f43d6-e021-48f7-a48f-38dc48bd0eee tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:07.713427 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-877f43d6-e021-48f7-a48f-38dc48bd0eee tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:07.714257 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-877f43d6-e021-48f7-a48f-38dc48bd0eee tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:07.714689 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-877f43d6-e021-48f7-a48f-38dc48bd0eee tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:07.731302 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.quota [None req-877f43d6-e021-48f7-a48f-38dc48bd0eee tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Getting quotas for project 666edd3825ba4e32ac180ed230d93e85. Resources: {'ram', 'instances', 'cores'} {{(pid=117940) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 18:38:07.735391 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.quota [None req-877f43d6-e021-48f7-a48f-38dc48bd0eee tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Getting quotas for user 784fdfd56b3d4ae4b6f68b66c4f06ea5 and project 666edd3825ba4e32ac180ed230d93e85. Resources: {'ram', 'instances', 'cores'} {{(pid=117940) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 18:38:07.748574 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-877f43d6-e021-48f7-a48f-38dc48bd0eee tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Going to run 1 instances... {{(pid=117940) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 18:38:07.750861 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-877f43d6-e021-48f7-a48f-38dc48bd0eee tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1da8585e-6dd6-458d-aa4d-047689501f3b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117940) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 18:38:07.803366 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-877f43d6-e021-48f7-a48f-38dc48bd0eee tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.601965 Jun 30 18:38:07.804019 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 470/945] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 30 18:38:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 30 18:38:07.813789 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-b02431e5-530c-488b-953b-be64e37f9027 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:07.814463 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-b02431e5-530c-488b-953b-be64e37f9027 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:07.889142 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-b02431e5-530c-488b-953b-be64e37f9027 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784fdfd56b3d4ae4b6f68b66c4f06ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666edd3825ba4e32ac180ed230d93e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:07.898433 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-b02431e5-530c-488b-953b-be64e37f9027 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 200 len: 1258 microversion: 2.1 time: 0.088547 Jun 30 18:38:07.899252 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 476/946] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:07 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 1258 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:38:08.351785 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-3707274a-de70-40f6-aad3-8b3221c87e64 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:08.352372 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-3707274a-de70-40f6-aad3-8b3221c87e64 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:08.358447 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3707274a-de70-40f6-aad3-8b3221c87e64 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:08.358891 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3707274a-de70-40f6-aad3-8b3221c87e64 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:08.359648 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3707274a-de70-40f6-aad3-8b3221c87e64 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:08.360081 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3707274a-de70-40f6-aad3-8b3221c87e64 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:08.499438 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-3707274a-de70-40f6-aad3-8b3221c87e64 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:08.521127 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-3707274a-de70-40f6-aad3-8b3221c87e64 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:08.522727 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-3707274a-de70-40f6-aad3-8b3221c87e64 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:08.523893 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-3707274a-de70-40f6-aad3-8b3221c87e64 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1731 microversion: 2.20 time: 0.177024 Jun 30 18:38:08.524651 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 471/947] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:38:08 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:38:08.915706 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-1039c2c7-40b5-4d90-9703-41a716ce6e8d tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:08.916386 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-1039c2c7-40b5-4d90-9703-41a716ce6e8d tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:08.923519 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1039c2c7-40b5-4d90-9703-41a716ce6e8d tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:08.923968 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1039c2c7-40b5-4d90-9703-41a716ce6e8d tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:08.924729 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1039c2c7-40b5-4d90-9703-41a716ce6e8d tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:08.925160 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1039c2c7-40b5-4d90-9703-41a716ce6e8d tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:08.985051 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-1039c2c7-40b5-4d90-9703-41a716ce6e8d tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784fdfd56b3d4ae4b6f68b66c4f06ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666edd3825ba4e32ac180ed230d93e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:08.993855 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-1039c2c7-40b5-4d90-9703-41a716ce6e8d tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 200 len: 1262 microversion: 2.1 time: 0.082737 Jun 30 18:38:09.003117 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 477/948] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:08 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:38:09.542540 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-f271e6d0-cd5d-4536-889f-4b4e649e4e08 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:09.543283 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-f271e6d0-cd5d-4536-889f-4b4e649e4e08 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:09.550073 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f271e6d0-cd5d-4536-889f-4b4e649e4e08 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:09.550523 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f271e6d0-cd5d-4536-889f-4b4e649e4e08 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:09.551285 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f271e6d0-cd5d-4536-889f-4b4e649e4e08 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:09.551721 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f271e6d0-cd5d-4536-889f-4b4e649e4e08 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:09.683722 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-f271e6d0-cd5d-4536-889f-4b4e649e4e08 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:09.691972 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-f271e6d0-cd5d-4536-889f-4b4e649e4e08 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:09.694250 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-f271e6d0-cd5d-4536-889f-4b4e649e4e08 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:09.695401 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-f271e6d0-cd5d-4536-889f-4b4e649e4e08 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1731 microversion: 2.20 time: 0.156957 Jun 30 18:38:09.695968 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 472/949] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:38:09 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:38:10.010611 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-cf7afe50-2465-4ab7-bbf0-fbc0b1398293 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:10.011217 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-cf7afe50-2465-4ab7-bbf0-fbc0b1398293 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:10.017698 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-cf7afe50-2465-4ab7-bbf0-fbc0b1398293 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:10.018140 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-cf7afe50-2465-4ab7-bbf0-fbc0b1398293 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:10.018890 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-cf7afe50-2465-4ab7-bbf0-fbc0b1398293 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:10.019337 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-cf7afe50-2465-4ab7-bbf0-fbc0b1398293 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:10.082882 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-cf7afe50-2465-4ab7-bbf0-fbc0b1398293 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784fdfd56b3d4ae4b6f68b66c4f06ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666edd3825ba4e32ac180ed230d93e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:10.090559 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-cf7afe50-2465-4ab7-bbf0-fbc0b1398293 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 200 len: 1262 microversion: 2.1 time: 0.083783 Jun 30 18:38:10.091122 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 478/950] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:10 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:38:10.714537 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-3be84e1b-4bdc-4d5d-aaf7-331c2a24264c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:10.715179 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-3be84e1b-4bdc-4d5d-aaf7-331c2a24264c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:10.722140 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3be84e1b-4bdc-4d5d-aaf7-331c2a24264c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:10.722595 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3be84e1b-4bdc-4d5d-aaf7-331c2a24264c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:10.723354 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3be84e1b-4bdc-4d5d-aaf7-331c2a24264c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:10.723789 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3be84e1b-4bdc-4d5d-aaf7-331c2a24264c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:10.857089 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-3be84e1b-4bdc-4d5d-aaf7-331c2a24264c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:10.865980 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-3be84e1b-4bdc-4d5d-aaf7-331c2a24264c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:10.867664 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-3be84e1b-4bdc-4d5d-aaf7-331c2a24264c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:10.868816 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-3be84e1b-4bdc-4d5d-aaf7-331c2a24264c tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1731 microversion: 2.20 time: 0.159245 Jun 30 18:38:10.869378 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 473/951] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:38:10 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:38:11.107784 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-b242ec98-c499-4600-9229-c3e4f998a690 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:11.108392 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-b242ec98-c499-4600-9229-c3e4f998a690 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:11.115011 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b242ec98-c499-4600-9229-c3e4f998a690 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:11.115465 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b242ec98-c499-4600-9229-c3e4f998a690 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:11.116223 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b242ec98-c499-4600-9229-c3e4f998a690 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:11.116654 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b242ec98-c499-4600-9229-c3e4f998a690 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:11.177176 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-b242ec98-c499-4600-9229-c3e4f998a690 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784fdfd56b3d4ae4b6f68b66c4f06ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666edd3825ba4e32ac180ed230d93e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:11.186134 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-b242ec98-c499-4600-9229-c3e4f998a690 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 200 len: 1262 microversion: 2.1 time: 0.081254 Jun 30 18:38:11.186873 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 479/952] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:11 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:38:11.887971 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-590993fb-562b-421c-bc26-89dc82f3bb4f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:11.888566 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-590993fb-562b-421c-bc26-89dc82f3bb4f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:11.894872 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-590993fb-562b-421c-bc26-89dc82f3bb4f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:11.895312 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-590993fb-562b-421c-bc26-89dc82f3bb4f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:11.896054 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-590993fb-562b-421c-bc26-89dc82f3bb4f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:11.896537 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-590993fb-562b-421c-bc26-89dc82f3bb4f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:12.027357 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-590993fb-562b-421c-bc26-89dc82f3bb4f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:12.035569 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-590993fb-562b-421c-bc26-89dc82f3bb4f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:12.037615 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-590993fb-562b-421c-bc26-89dc82f3bb4f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:12.038771 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-590993fb-562b-421c-bc26-89dc82f3bb4f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1731 microversion: 2.20 time: 0.154633 Jun 30 18:38:12.039323 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 474/953] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:38:11 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 18:38:12.206505 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-e8229312-b3a3-449c-afc2-954b5ab53d54 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:12.207295 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-e8229312-b3a3-449c-afc2-954b5ab53d54 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:12.213904 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e8229312-b3a3-449c-afc2-954b5ab53d54 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:12.214339 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e8229312-b3a3-449c-afc2-954b5ab53d54 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:12.215095 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e8229312-b3a3-449c-afc2-954b5ab53d54 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:12.215519 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e8229312-b3a3-449c-afc2-954b5ab53d54 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:12.275462 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-e8229312-b3a3-449c-afc2-954b5ab53d54 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784fdfd56b3d4ae4b6f68b66c4f06ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666edd3825ba4e32ac180ed230d93e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:12.282613 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-e8229312-b3a3-449c-afc2-954b5ab53d54 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 200 len: 1262 microversion: 2.1 time: 0.080362 Jun 30 18:38:12.283165 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 480/954] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:12 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:38:13.057560 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-8bec5258-9eda-46a5-8538-493f250c9834 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:13.058196 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-8bec5258-9eda-46a5-8538-493f250c9834 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:13.064750 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8bec5258-9eda-46a5-8538-493f250c9834 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:13.065195 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8bec5258-9eda-46a5-8538-493f250c9834 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:13.065983 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8bec5258-9eda-46a5-8538-493f250c9834 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:13.066420 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8bec5258-9eda-46a5-8538-493f250c9834 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:13.195564 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-8bec5258-9eda-46a5-8538-493f250c9834 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:13.203386 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-8bec5258-9eda-46a5-8538-493f250c9834 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:13.204874 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-8bec5258-9eda-46a5-8538-493f250c9834 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:13.206056 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-8bec5258-9eda-46a5-8538-493f250c9834 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1731 microversion: 2.20 time: 0.152422 Jun 30 18:38:13.206614 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 475/955] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:38:13 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:38:13.299713 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-658e56aa-0918-4210-ac8e-73eb64c190b5 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:13.300254 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-658e56aa-0918-4210-ac8e-73eb64c190b5 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:13.307249 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-658e56aa-0918-4210-ac8e-73eb64c190b5 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:13.307698 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-658e56aa-0918-4210-ac8e-73eb64c190b5 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:13.308457 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-658e56aa-0918-4210-ac8e-73eb64c190b5 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:13.308892 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-658e56aa-0918-4210-ac8e-73eb64c190b5 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:13.371782 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-658e56aa-0918-4210-ac8e-73eb64c190b5 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784fdfd56b3d4ae4b6f68b66c4f06ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666edd3825ba4e32ac180ed230d93e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:13.379098 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-658e56aa-0918-4210-ac8e-73eb64c190b5 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 200 len: 1262 microversion: 2.1 time: 0.083370 Jun 30 18:38:13.379670 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 481/956] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:13 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:38:14.224191 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-e4d2dce5-4bf6-45d8-8cf6-5a065a8fcb2b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:14.225733 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-e4d2dce5-4bf6-45d8-8cf6-5a065a8fcb2b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:14.232049 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e4d2dce5-4bf6-45d8-8cf6-5a065a8fcb2b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:14.232572 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e4d2dce5-4bf6-45d8-8cf6-5a065a8fcb2b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:14.233382 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e4d2dce5-4bf6-45d8-8cf6-5a065a8fcb2b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:14.234083 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e4d2dce5-4bf6-45d8-8cf6-5a065a8fcb2b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:14.364809 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-e4d2dce5-4bf6-45d8-8cf6-5a065a8fcb2b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:14.372631 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-e4d2dce5-4bf6-45d8-8cf6-5a065a8fcb2b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:14.374160 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-e4d2dce5-4bf6-45d8-8cf6-5a065a8fcb2b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:14.375301 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-e4d2dce5-4bf6-45d8-8cf6-5a065a8fcb2b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1731 microversion: 2.20 time: 0.155078 Jun 30 18:38:14.375864 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 476/957] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:38:14 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:38:14.396949 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-2a67ec06-7fe1-4cbc-b588-9c96381a748c tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:14.397706 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-2a67ec06-7fe1-4cbc-b588-9c96381a748c tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:14.404155 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2a67ec06-7fe1-4cbc-b588-9c96381a748c tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:14.404590 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2a67ec06-7fe1-4cbc-b588-9c96381a748c tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:14.405334 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2a67ec06-7fe1-4cbc-b588-9c96381a748c tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:14.405786 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2a67ec06-7fe1-4cbc-b588-9c96381a748c tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:14.465845 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-2a67ec06-7fe1-4cbc-b588-9c96381a748c tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784fdfd56b3d4ae4b6f68b66c4f06ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666edd3825ba4e32ac180ed230d93e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:14.473207 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-2a67ec06-7fe1-4cbc-b588-9c96381a748c tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 200 len: 1262 microversion: 2.1 time: 0.081025 Jun 30 18:38:14.473790 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 482/958] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:14 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:38:15.394413 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-747a2f03-cc76-45f0-82b4-7dc8b7fd0237 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:15.395019 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-747a2f03-cc76-45f0-82b4-7dc8b7fd0237 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:15.402158 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-747a2f03-cc76-45f0-82b4-7dc8b7fd0237 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:15.402607 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-747a2f03-cc76-45f0-82b4-7dc8b7fd0237 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:15.403366 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-747a2f03-cc76-45f0-82b4-7dc8b7fd0237 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:15.403803 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-747a2f03-cc76-45f0-82b4-7dc8b7fd0237 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:15.489628 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-fa3241a0-2c1d-456e-86ac-200660641080 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:15.490264 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-fa3241a0-2c1d-456e-86ac-200660641080 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:15.496745 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fa3241a0-2c1d-456e-86ac-200660641080 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:15.497187 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fa3241a0-2c1d-456e-86ac-200660641080 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:15.497992 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fa3241a0-2c1d-456e-86ac-200660641080 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:15.498423 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fa3241a0-2c1d-456e-86ac-200660641080 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:15.549311 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-747a2f03-cc76-45f0-82b4-7dc8b7fd0237 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:15.558455 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-747a2f03-cc76-45f0-82b4-7dc8b7fd0237 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:15.560040 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-747a2f03-cc76-45f0-82b4-7dc8b7fd0237 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:15.561323 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-747a2f03-cc76-45f0-82b4-7dc8b7fd0237 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1731 microversion: 2.20 time: 0.170796 Jun 30 18:38:15.561942 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 477/959] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:38:15 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:38:15.565504 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-fa3241a0-2c1d-456e-86ac-200660641080 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784fdfd56b3d4ae4b6f68b66c4f06ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666edd3825ba4e32ac180ed230d93e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:15.573232 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-fa3241a0-2c1d-456e-86ac-200660641080 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 200 len: 1310 microversion: 2.1 time: 0.087465 Jun 30 18:38:15.573897 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 483/960] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:15 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 1310 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:38:16.579705 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-cbbcbd7c-1e59-4bb6-a7d0-e8e155651810 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:16.580294 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-cbbcbd7c-1e59-4bb6-a7d0-e8e155651810 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:16.588566 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cbbcbd7c-1e59-4bb6-a7d0-e8e155651810 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:16.589103 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cbbcbd7c-1e59-4bb6-a7d0-e8e155651810 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:16.590012 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cbbcbd7c-1e59-4bb6-a7d0-e8e155651810 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:16.590248 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-dd39c00f-e284-4848-8cf9-ffdc04bf66b5 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:16.590747 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cbbcbd7c-1e59-4bb6-a7d0-e8e155651810 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:16.590849 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-dd39c00f-e284-4848-8cf9-ffdc04bf66b5 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:16.597568 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-dd39c00f-e284-4848-8cf9-ffdc04bf66b5 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:16.598040 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-dd39c00f-e284-4848-8cf9-ffdc04bf66b5 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:16.598788 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-dd39c00f-e284-4848-8cf9-ffdc04bf66b5 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:16.599211 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-dd39c00f-e284-4848-8cf9-ffdc04bf66b5 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:16.616387 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:38:16.801336 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-dd39c00f-e284-4848-8cf9-ffdc04bf66b5 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784fdfd56b3d4ae4b6f68b66c4f06ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666edd3825ba4e32ac180ed230d93e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:16.810353 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-dd39c00f-e284-4848-8cf9-ffdc04bf66b5 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 200 len: 1358 microversion: 2.1 time: 0.223883 Jun 30 18:38:16.811181 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 484/961] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:16 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 1358 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:38:16.817075 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-cbbcbd7c-1e59-4bb6-a7d0-e8e155651810 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:16.825889 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-cbbcbd7c-1e59-4bb6-a7d0-e8e155651810 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:16.827384 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-cbbcbd7c-1e59-4bb6-a7d0-e8e155651810 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:16.828553 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-cbbcbd7c-1e59-4bb6-a7d0-e8e155651810 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1731 microversion: 2.20 time: 0.252753 Jun 30 18:38:16.839648 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 478/962] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:38:16 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1731 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:38:17.828148 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-50eec960-d206-4833-b775-e225a9ee9d15 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:17.828778 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-50eec960-d206-4833-b775-e225a9ee9d15 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:17.835555 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-50eec960-d206-4833-b775-e225a9ee9d15 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:17.836255 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-50eec960-d206-4833-b775-e225a9ee9d15 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:17.837218 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-50eec960-d206-4833-b775-e225a9ee9d15 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:17.837682 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-50eec960-d206-4833-b775-e225a9ee9d15 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:17.847340 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-6332e7e3-8331-4458-ba82-9cabbe1f78bc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:17.847945 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-6332e7e3-8331-4458-ba82-9cabbe1f78bc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:17.851058 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell0:SELECT=2 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:38:17.851722 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell0:SELECT=10 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:38:17.866406 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6332e7e3-8331-4458-ba82-9cabbe1f78bc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:17.867653 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6332e7e3-8331-4458-ba82-9cabbe1f78bc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:17.868643 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6332e7e3-8331-4458-ba82-9cabbe1f78bc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:17.869297 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6332e7e3-8331-4458-ba82-9cabbe1f78bc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:17.890192 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=93,nova_cell1:UPDATE=4 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:38:17.893897 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell0:SELECT=2 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:38:18.024860 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-50eec960-d206-4833-b775-e225a9ee9d15 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784fdfd56b3d4ae4b6f68b66c4f06ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666edd3825ba4e32ac180ed230d93e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:18.036248 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-50eec960-d206-4833-b775-e225a9ee9d15 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 200 len: 1358 microversion: 2.1 time: 0.211891 Jun 30 18:38:18.036832 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 485/963] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:17 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:38:18.069020 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-6332e7e3-8331-4458-ba82-9cabbe1f78bc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:18.078137 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-6332e7e3-8331-4458-ba82-9cabbe1f78bc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:18.079993 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-6332e7e3-8331-4458-ba82-9cabbe1f78bc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:18.081361 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-6332e7e3-8331-4458-ba82-9cabbe1f78bc tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1731 microversion: 2.20 time: 0.237972 Jun 30 18:38:18.081953 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 479/964] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:38:17 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1731 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 18:38:19.053798 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-57d7f996-5e74-44e9-96ca-a34f1f0e3422 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:19.055043 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-57d7f996-5e74-44e9-96ca-a34f1f0e3422 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:19.061883 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-57d7f996-5e74-44e9-96ca-a34f1f0e3422 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:19.062575 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-57d7f996-5e74-44e9-96ca-a34f1f0e3422 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:19.063531 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-57d7f996-5e74-44e9-96ca-a34f1f0e3422 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:19.064171 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-57d7f996-5e74-44e9-96ca-a34f1f0e3422 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:19.106315 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-19c261fb-a2dc-4414-8933-13c30e3d5bce tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:19.107597 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-19c261fb-a2dc-4414-8933-13c30e3d5bce tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:19.123974 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-19c261fb-a2dc-4414-8933-13c30e3d5bce tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:19.124730 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-19c261fb-a2dc-4414-8933-13c30e3d5bce tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:19.125705 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-19c261fb-a2dc-4414-8933-13c30e3d5bce tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:19.127767 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-19c261fb-a2dc-4414-8933-13c30e3d5bce tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:19.235906 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-57d7f996-5e74-44e9-96ca-a34f1f0e3422 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784fdfd56b3d4ae4b6f68b66c4f06ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666edd3825ba4e32ac180ed230d93e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:19.250342 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-57d7f996-5e74-44e9-96ca-a34f1f0e3422 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 200 len: 1358 microversion: 2.1 time: 0.200801 Jun 30 18:38:19.252928 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 486/965] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:19 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 1358 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:38:19.266915 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-e2b078b2-787e-4bc7-af4c-5c479284b90e req-c4ebce32-a61c-4111-bf0d-8255031496a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2c839c4-5e9d-433d-ac94-1d8f3f0875e3", "name": "network-vif-plugged", "status": "completed", "tag": "c81ef70e-10e5-414c-8ee1-71b2bd8320c9"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:38:19.292464 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-e2b078b2-787e-4bc7-af4c-5c479284b90e req-c4ebce32-a61c-4111-bf0d-8255031496a1 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:19.294215 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-e2b078b2-787e-4bc7-af4c-5c479284b90e req-c4ebce32-a61c-4111-bf0d-8255031496a1 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:19.325615 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.compute.server_external_events [req-e2b078b2-787e-4bc7-af4c-5c479284b90e req-c4ebce32-a61c-4111-bf0d-8255031496a1 service nova] Creating event network-vif-plugged:c81ef70e-10e5-414c-8ee1-71b2bd8320c9 for instance a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 on hv-cinder-80378 Jun 30 18:38:19.327954 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-e2b078b2-787e-4bc7-af4c-5c479284b90e req-c4ebce32-a61c-4111-bf0d-8255031496a1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070853 Jun 30 18:38:19.327954 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 487/966] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:38:19.502636 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-19c261fb-a2dc-4414-8933-13c30e3d5bce tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:19.511091 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-19c261fb-a2dc-4414-8933-13c30e3d5bce tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:19.512572 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-19c261fb-a2dc-4414-8933-13c30e3d5bce tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:19.513750 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-19c261fb-a2dc-4414-8933-13c30e3d5bce tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1731 microversion: 2.20 time: 0.417258 Jun 30 18:38:19.514312 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 480/967] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:38:19 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1731 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:38:20.269294 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-5b7e786e-11e9-4da3-8264-989b52e7d8aa tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:20.270139 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-5b7e786e-11e9-4da3-8264-989b52e7d8aa tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:20.277279 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-5b7e786e-11e9-4da3-8264-989b52e7d8aa tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:20.277763 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-5b7e786e-11e9-4da3-8264-989b52e7d8aa tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:20.278603 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-5b7e786e-11e9-4da3-8264-989b52e7d8aa tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:20.278971 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-5b7e786e-11e9-4da3-8264-989b52e7d8aa tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:20.420868 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-5b7e786e-11e9-4da3-8264-989b52e7d8aa tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784fdfd56b3d4ae4b6f68b66c4f06ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666edd3825ba4e32ac180ed230d93e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:20.428293 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-5b7e786e-11e9-4da3-8264-989b52e7d8aa tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 200 len: 1358 microversion: 2.1 time: 0.163698 Jun 30 18:38:20.428863 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 488/968] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:20 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:38:20.532868 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-6c3fb8fe-05ec-4c8b-92cb-e0d63489bd37 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:20.533519 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-6c3fb8fe-05ec-4c8b-92cb-e0d63489bd37 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:20.540958 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6c3fb8fe-05ec-4c8b-92cb-e0d63489bd37 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:20.541513 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6c3fb8fe-05ec-4c8b-92cb-e0d63489bd37 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:20.542546 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6c3fb8fe-05ec-4c8b-92cb-e0d63489bd37 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:20.543183 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6c3fb8fe-05ec-4c8b-92cb-e0d63489bd37 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:20.680235 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-6c3fb8fe-05ec-4c8b-92cb-e0d63489bd37 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:20.688437 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-6c3fb8fe-05ec-4c8b-92cb-e0d63489bd37 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:20.689967 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-6c3fb8fe-05ec-4c8b-92cb-e0d63489bd37 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:20.691134 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-6c3fb8fe-05ec-4c8b-92cb-e0d63489bd37 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1731 microversion: 2.20 time: 0.162812 Jun 30 18:38:20.691684 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 481/969] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:38:20 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:38:21.445754 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-a7638541-caac-410f-b189-1e45b55a0f64 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:21.447441 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-a7638541-caac-410f-b189-1e45b55a0f64 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:21.454659 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a7638541-caac-410f-b189-1e45b55a0f64 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:21.455902 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a7638541-caac-410f-b189-1e45b55a0f64 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:21.457264 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a7638541-caac-410f-b189-1e45b55a0f64 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:21.457947 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a7638541-caac-410f-b189-1e45b55a0f64 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:21.607010 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-a7638541-caac-410f-b189-1e45b55a0f64 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784fdfd56b3d4ae4b6f68b66c4f06ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666edd3825ba4e32ac180ed230d93e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:21.615123 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-a7638541-caac-410f-b189-1e45b55a0f64 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 200 len: 1358 microversion: 2.1 time: 0.173525 Jun 30 18:38:21.617631 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 489/970] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:21 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:38:21.709213 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-0fe512be-760b-4a24-bca7-629958626717 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:21.709827 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-0fe512be-760b-4a24-bca7-629958626717 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:21.718414 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0fe512be-760b-4a24-bca7-629958626717 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:21.719276 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0fe512be-760b-4a24-bca7-629958626717 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:21.721375 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0fe512be-760b-4a24-bca7-629958626717 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:21.722064 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0fe512be-760b-4a24-bca7-629958626717 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:21.902258 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-0fe512be-760b-4a24-bca7-629958626717 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:21.912256 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-0fe512be-760b-4a24-bca7-629958626717 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:21.914271 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-0fe512be-760b-4a24-bca7-629958626717 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:21.915442 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-0fe512be-760b-4a24-bca7-629958626717 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1731 microversion: 2.20 time: 0.210219 Jun 30 18:38:21.916414 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 482/971] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:38:21 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1731 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 18:38:22.633975 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-4fa87b8b-f061-4fe4-8055-6dc0606910ff tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:22.634802 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-4fa87b8b-f061-4fe4-8055-6dc0606910ff tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:22.641996 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-4fa87b8b-f061-4fe4-8055-6dc0606910ff tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:22.642444 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-4fa87b8b-f061-4fe4-8055-6dc0606910ff tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:22.643215 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-4fa87b8b-f061-4fe4-8055-6dc0606910ff tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:22.643646 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-4fa87b8b-f061-4fe4-8055-6dc0606910ff tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:22.786557 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-4fa87b8b-f061-4fe4-8055-6dc0606910ff tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784fdfd56b3d4ae4b6f68b66c4f06ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666edd3825ba4e32ac180ed230d93e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:22.797892 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-4fa87b8b-f061-4fe4-8055-6dc0606910ff tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 200 len: 1358 microversion: 2.1 time: 0.168163 Jun 30 18:38:22.800219 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 490/972] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:22 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:38:22.934494 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-7576257d-1655-41c4-ab5e-cb036312639b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:22.935138 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-7576257d-1655-41c4-ab5e-cb036312639b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:22.938607 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=4 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:38:22.942558 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7576257d-1655-41c4-ab5e-cb036312639b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:22.943046 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7576257d-1655-41c4-ab5e-cb036312639b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:22.943822 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7576257d-1655-41c4-ab5e-cb036312639b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:22.944253 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7576257d-1655-41c4-ab5e-cb036312639b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:23.098932 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-7576257d-1655-41c4-ab5e-cb036312639b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:23.107666 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-7576257d-1655-41c4-ab5e-cb036312639b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:23.109153 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-7576257d-1655-41c4-ab5e-cb036312639b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:23.110333 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-7576257d-1655-41c4-ab5e-cb036312639b tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1731 microversion: 2.20 time: 0.179880 Jun 30 18:38:23.110889 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 483/973] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:38:22 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1731 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:38:23.815052 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-d41ddefc-4915-4fb7-9060-5f2f7fdc2d68 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:23.815719 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-d41ddefc-4915-4fb7-9060-5f2f7fdc2d68 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:23.818119 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_api:SELECT=48 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:38:23.823816 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d41ddefc-4915-4fb7-9060-5f2f7fdc2d68 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:23.824261 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d41ddefc-4915-4fb7-9060-5f2f7fdc2d68 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:23.825026 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d41ddefc-4915-4fb7-9060-5f2f7fdc2d68 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:23.825458 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d41ddefc-4915-4fb7-9060-5f2f7fdc2d68 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:23.981821 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-d41ddefc-4915-4fb7-9060-5f2f7fdc2d68 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784fdfd56b3d4ae4b6f68b66c4f06ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666edd3825ba4e32ac180ed230d93e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:23.998569 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-d41ddefc-4915-4fb7-9060-5f2f7fdc2d68 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 200 len: 1358 microversion: 2.1 time: 0.187299 Jun 30 18:38:24.002342 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 491/974] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:23 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:38:24.128610 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-366fdd6c-1013-4c71-bc33-e8c9f10532e0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:24.129198 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-366fdd6c-1013-4c71-bc33-e8c9f10532e0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:24.136368 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-366fdd6c-1013-4c71-bc33-e8c9f10532e0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:24.136966 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-366fdd6c-1013-4c71-bc33-e8c9f10532e0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:24.137770 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-366fdd6c-1013-4c71-bc33-e8c9f10532e0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:24.138208 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-366fdd6c-1013-4c71-bc33-e8c9f10532e0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:24.544371 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-366fdd6c-1013-4c71-bc33-e8c9f10532e0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:24.552621 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-366fdd6c-1013-4c71-bc33-e8c9f10532e0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:24.554701 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-366fdd6c-1013-4c71-bc33-e8c9f10532e0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:24.556365 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-366fdd6c-1013-4c71-bc33-e8c9f10532e0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1731 microversion: 2.20 time: 0.431867 Jun 30 18:38:24.556968 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 484/975] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:38:24 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1731 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:38:25.020644 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-943173a8-74a4-4d0b-828f-7a25bf434e0a tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:25.024431 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-943173a8-74a4-4d0b-828f-7a25bf434e0a tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:25.028072 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-943173a8-74a4-4d0b-828f-7a25bf434e0a tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:25.028534 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-943173a8-74a4-4d0b-828f-7a25bf434e0a tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:25.029332 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-943173a8-74a4-4d0b-828f-7a25bf434e0a tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:25.029811 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-943173a8-74a4-4d0b-828f-7a25bf434e0a tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:25.158047 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-943173a8-74a4-4d0b-828f-7a25bf434e0a tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784fdfd56b3d4ae4b6f68b66c4f06ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666edd3825ba4e32ac180ed230d93e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:25.165936 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-943173a8-74a4-4d0b-828f-7a25bf434e0a tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 200 len: 1358 microversion: 2.1 time: 0.149893 Jun 30 18:38:25.166495 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 492/976] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:25 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:38:25.575301 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-a44af3ad-95d2-4082-9325-4bb30bee0ff0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:25.575936 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-a44af3ad-95d2-4082-9325-4bb30bee0ff0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:25.582352 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a44af3ad-95d2-4082-9325-4bb30bee0ff0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:25.582802 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a44af3ad-95d2-4082-9325-4bb30bee0ff0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:25.583569 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a44af3ad-95d2-4082-9325-4bb30bee0ff0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:25.584005 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a44af3ad-95d2-4082-9325-4bb30bee0ff0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:25.764234 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-a44af3ad-95d2-4082-9325-4bb30bee0ff0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:25.771956 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-a44af3ad-95d2-4082-9325-4bb30bee0ff0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:25.774011 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-a44af3ad-95d2-4082-9325-4bb30bee0ff0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:25.775156 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-a44af3ad-95d2-4082-9325-4bb30bee0ff0 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1731 microversion: 2.20 time: 0.203871 Jun 30 18:38:25.775681 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 485/977] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:38:25 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1731 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:38:26.182921 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-b2f82e7c-b710-4c16-b877-611dab21ad09 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:26.183530 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-b2f82e7c-b710-4c16-b877-611dab21ad09 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:26.190022 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b2f82e7c-b710-4c16-b877-611dab21ad09 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:26.190411 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b2f82e7c-b710-4c16-b877-611dab21ad09 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:26.191162 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b2f82e7c-b710-4c16-b877-611dab21ad09 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:26.191607 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-b2f82e7c-b710-4c16-b877-611dab21ad09 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:26.324118 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-b2f82e7c-b710-4c16-b877-611dab21ad09 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784fdfd56b3d4ae4b6f68b66c4f06ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666edd3825ba4e32ac180ed230d93e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:26.331492 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-b2f82e7c-b710-4c16-b877-611dab21ad09 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 200 len: 1358 microversion: 2.1 time: 0.152970 Jun 30 18:38:26.332051 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 493/978] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:26 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:38:26.794390 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-f0dbf34d-2a54-44eb-918f-9cc3df56c2db tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:26.794993 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-f0dbf34d-2a54-44eb-918f-9cc3df56c2db tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:26.801099 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f0dbf34d-2a54-44eb-918f-9cc3df56c2db tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:26.801546 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f0dbf34d-2a54-44eb-918f-9cc3df56c2db tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:26.802327 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f0dbf34d-2a54-44eb-918f-9cc3df56c2db tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:26.802759 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f0dbf34d-2a54-44eb-918f-9cc3df56c2db tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:26.938048 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-f0dbf34d-2a54-44eb-918f-9cc3df56c2db tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:26.946036 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-f0dbf34d-2a54-44eb-918f-9cc3df56c2db tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:26.947532 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-f0dbf34d-2a54-44eb-918f-9cc3df56c2db tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:26.948682 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-f0dbf34d-2a54-44eb-918f-9cc3df56c2db tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1731 microversion: 2.20 time: 0.158224 Jun 30 18:38:26.949229 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 486/979] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:38:26 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 18:38:27.350704 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-7de4abd7-a13c-4d66-8821-d83d30316b18 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:27.351345 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-7de4abd7-a13c-4d66-8821-d83d30316b18 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:27.357865 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7de4abd7-a13c-4d66-8821-d83d30316b18 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:27.358302 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7de4abd7-a13c-4d66-8821-d83d30316b18 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:27.359048 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7de4abd7-a13c-4d66-8821-d83d30316b18 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:27.359468 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7de4abd7-a13c-4d66-8821-d83d30316b18 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:27.499401 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-7de4abd7-a13c-4d66-8821-d83d30316b18 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784fdfd56b3d4ae4b6f68b66c4f06ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666edd3825ba4e32ac180ed230d93e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:27.507348 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-7de4abd7-a13c-4d66-8821-d83d30316b18 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 200 len: 1358 microversion: 2.1 time: 0.160481 Jun 30 18:38:27.507348 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 494/980] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:27 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:38:27.967353 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-734420e7-8ab6-43b5-b7b3-6c4a08967a9a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:27.968841 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-734420e7-8ab6-43b5-b7b3-6c4a08967a9a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:27.975943 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-734420e7-8ab6-43b5-b7b3-6c4a08967a9a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:27.976918 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-734420e7-8ab6-43b5-b7b3-6c4a08967a9a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:27.977726 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-734420e7-8ab6-43b5-b7b3-6c4a08967a9a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:27.978163 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-734420e7-8ab6-43b5-b7b3-6c4a08967a9a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:28.125699 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-734420e7-8ab6-43b5-b7b3-6c4a08967a9a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:28.133658 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-734420e7-8ab6-43b5-b7b3-6c4a08967a9a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:28.135151 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-734420e7-8ab6-43b5-b7b3-6c4a08967a9a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:28.136414 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-734420e7-8ab6-43b5-b7b3-6c4a08967a9a tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1731 microversion: 2.20 time: 0.173224 Jun 30 18:38:28.136971 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 487/981] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:38:27 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:38:28.527011 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-2213664d-6621-4f4b-8f4a-7e25e7daa21e tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:28.527588 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-2213664d-6621-4f4b-8f4a-7e25e7daa21e tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:28.534153 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2213664d-6621-4f4b-8f4a-7e25e7daa21e tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:28.534879 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2213664d-6621-4f4b-8f4a-7e25e7daa21e tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:28.535635 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2213664d-6621-4f4b-8f4a-7e25e7daa21e tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:28.536061 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2213664d-6621-4f4b-8f4a-7e25e7daa21e tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:28.724915 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-2213664d-6621-4f4b-8f4a-7e25e7daa21e tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784fdfd56b3d4ae4b6f68b66c4f06ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666edd3825ba4e32ac180ed230d93e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:28.733071 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-2213664d-6621-4f4b-8f4a-7e25e7daa21e tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 200 len: 1358 microversion: 2.1 time: 0.210794 Jun 30 18:38:28.742943 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 495/982] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:28 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 1358 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:38:28.888217 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [req-012e94f9-9f5c-44dc-b33a-87fead244763 req-46580842-a43d-440a-b049-05338a320539 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4a22a51-62b8-4ad0-88e4-f959b6cc606f", "tag": "66b87a68-1890-42c6-b759-72e44f506ff1"}]} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:38:28.897211 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-012e94f9-9f5c-44dc-b33a-87fead244763 req-46580842-a43d-440a-b049-05338a320539 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:28.897663 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-012e94f9-9f5c-44dc-b33a-87fead244763 req-46580842-a43d-440a-b049-05338a320539 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:28.909174 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.compute.server_external_events [req-012e94f9-9f5c-44dc-b33a-87fead244763 req-46580842-a43d-440a-b049-05338a320539 service nova] Creating event network-changed:66b87a68-1890-42c6-b759-72e44f506ff1 for instance c4a22a51-62b8-4ad0-88e4-f959b6cc606f on hv-cinder-80378 Jun 30 18:38:28.914598 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [req-012e94f9-9f5c-44dc-b33a-87fead244763 req-46580842-a43d-440a-b049-05338a320539 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030708 Jun 30 18:38:28.915197 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 488/983] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:38:29.154604 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-040e9387-9aeb-4cb2-bc48-a9b8016ea4be tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:29.155278 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-040e9387-9aeb-4cb2-bc48-a9b8016ea4be tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:29.161253 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-040e9387-9aeb-4cb2-bc48-a9b8016ea4be tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:29.161740 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-040e9387-9aeb-4cb2-bc48-a9b8016ea4be tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:29.162504 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-040e9387-9aeb-4cb2-bc48-a9b8016ea4be tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:29.162938 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-040e9387-9aeb-4cb2-bc48-a9b8016ea4be tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:29.294898 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-040e9387-9aeb-4cb2-bc48-a9b8016ea4be tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:29.302739 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-040e9387-9aeb-4cb2-bc48-a9b8016ea4be tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:29.304204 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-040e9387-9aeb-4cb2-bc48-a9b8016ea4be tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:29.305990 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-040e9387-9aeb-4cb2-bc48-a9b8016ea4be tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1731 microversion: 2.20 time: 0.155420 Jun 30 18:38:29.306540 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 496/984] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:38:29 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:38:29.751487 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-fb88383a-4b6f-4c25-8cc4-f9d30239e14e tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:29.752169 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-fb88383a-4b6f-4c25-8cc4-f9d30239e14e tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:29.758262 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fb88383a-4b6f-4c25-8cc4-f9d30239e14e tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:29.758696 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fb88383a-4b6f-4c25-8cc4-f9d30239e14e tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:29.759441 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fb88383a-4b6f-4c25-8cc4-f9d30239e14e tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:29.759866 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fb88383a-4b6f-4c25-8cc4-f9d30239e14e tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:29.890035 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-fb88383a-4b6f-4c25-8cc4-f9d30239e14e tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784fdfd56b3d4ae4b6f68b66c4f06ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666edd3825ba4e32ac180ed230d93e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:29.897311 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-fb88383a-4b6f-4c25-8cc4-f9d30239e14e tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 200 len: 1358 microversion: 2.1 time: 0.150441 Jun 30 18:38:29.897907 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 489/985] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:29 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:38:30.324654 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-d4f333a8-d39a-43b5-a8af-5bc29f1a1e09 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:30.325269 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-d4f333a8-d39a-43b5-a8af-5bc29f1a1e09 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:30.331816 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d4f333a8-d39a-43b5-a8af-5bc29f1a1e09 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:30.332265 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d4f333a8-d39a-43b5-a8af-5bc29f1a1e09 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:30.333025 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d4f333a8-d39a-43b5-a8af-5bc29f1a1e09 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:30.333459 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d4f333a8-d39a-43b5-a8af-5bc29f1a1e09 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:30.479601 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-d4f333a8-d39a-43b5-a8af-5bc29f1a1e09 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:30.505335 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-d4f333a8-d39a-43b5-a8af-5bc29f1a1e09 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:30.507066 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-d4f333a8-d39a-43b5-a8af-5bc29f1a1e09 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:30.509033 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-d4f333a8-d39a-43b5-a8af-5bc29f1a1e09 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1731 microversion: 2.20 time: 0.188876 Jun 30 18:38:30.519929 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 497/986] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:38:30 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1731 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:38:30.915291 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-7636689c-26b0-4b42-8fc7-35b1b823115c tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:30.915898 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-7636689c-26b0-4b42-8fc7-35b1b823115c tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:30.922354 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7636689c-26b0-4b42-8fc7-35b1b823115c tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:30.922797 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7636689c-26b0-4b42-8fc7-35b1b823115c tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:30.923542 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7636689c-26b0-4b42-8fc7-35b1b823115c tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:30.923968 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7636689c-26b0-4b42-8fc7-35b1b823115c tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:31.052652 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-7636689c-26b0-4b42-8fc7-35b1b823115c tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784fdfd56b3d4ae4b6f68b66c4f06ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666edd3825ba4e32ac180ed230d93e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:31.060790 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-7636689c-26b0-4b42-8fc7-35b1b823115c tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 200 len: 1358 microversion: 2.1 time: 0.150322 Jun 30 18:38:31.061362 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 490/987] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:30 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:38:31.528146 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-fe844205-4328-47f7-b690-fe792ceaa2ab tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:31.528741 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-fe844205-4328-47f7-b690-fe792ceaa2ab tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:31.535415 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fe844205-4328-47f7-b690-fe792ceaa2ab tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:31.535853 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fe844205-4328-47f7-b690-fe792ceaa2ab tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:31.536595 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fe844205-4328-47f7-b690-fe792ceaa2ab tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:31.537015 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fe844205-4328-47f7-b690-fe792ceaa2ab tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:31.666856 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-fe844205-4328-47f7-b690-fe792ceaa2ab tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:31.674905 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-fe844205-4328-47f7-b690-fe792ceaa2ab tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:31.676399 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-fe844205-4328-47f7-b690-fe792ceaa2ab tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:31.677596 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-fe844205-4328-47f7-b690-fe792ceaa2ab tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1731 microversion: 2.20 time: 0.153332 Jun 30 18:38:31.678197 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 498/988] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:38:31 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 18:38:32.077701 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-b2a089c0-272b-4e6f-a45e-1497e0eefa77 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:32.078348 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-b2a089c0-272b-4e6f-a45e-1497e0eefa77 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:32.084714 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b2a089c0-272b-4e6f-a45e-1497e0eefa77 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:32.085161 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b2a089c0-272b-4e6f-a45e-1497e0eefa77 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:32.085943 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b2a089c0-272b-4e6f-a45e-1497e0eefa77 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:32.086375 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b2a089c0-272b-4e6f-a45e-1497e0eefa77 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:32.214949 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-b2a089c0-272b-4e6f-a45e-1497e0eefa77 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784fdfd56b3d4ae4b6f68b66c4f06ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666edd3825ba4e32ac180ed230d93e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:32.222517 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-b2a089c0-272b-4e6f-a45e-1497e0eefa77 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 200 len: 1358 microversion: 2.1 time: 0.148749 Jun 30 18:38:32.223078 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 491/989] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:32 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:38:32.696232 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-da626045-477c-4e0d-b85b-757d65f5d170 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:32.696889 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-da626045-477c-4e0d-b85b-757d65f5d170 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:32.703420 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-da626045-477c-4e0d-b85b-757d65f5d170 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:32.703866 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-da626045-477c-4e0d-b85b-757d65f5d170 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:32.704620 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-da626045-477c-4e0d-b85b-757d65f5d170 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:32.705051 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-da626045-477c-4e0d-b85b-757d65f5d170 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:32.832831 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-da626045-477c-4e0d-b85b-757d65f5d170 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:32.841642 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-da626045-477c-4e0d-b85b-757d65f5d170 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:32.843419 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-da626045-477c-4e0d-b85b-757d65f5d170 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:32.844572 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-da626045-477c-4e0d-b85b-757d65f5d170 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1731 microversion: 2.20 time: 0.152358 Jun 30 18:38:32.845123 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 499/990] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:38:32 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:38:33.239066 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-350122d7-40e3-422e-bfb7-166cb110741c tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:33.239678 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-350122d7-40e3-422e-bfb7-166cb110741c tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:33.246325 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-350122d7-40e3-422e-bfb7-166cb110741c tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:33.246766 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-350122d7-40e3-422e-bfb7-166cb110741c tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:33.247518 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-350122d7-40e3-422e-bfb7-166cb110741c tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:33.247949 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-350122d7-40e3-422e-bfb7-166cb110741c tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:33.382838 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-350122d7-40e3-422e-bfb7-166cb110741c tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784fdfd56b3d4ae4b6f68b66c4f06ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666edd3825ba4e32ac180ed230d93e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:33.391097 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-350122d7-40e3-422e-bfb7-166cb110741c tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 200 len: 1358 microversion: 2.1 time: 0.155857 Jun 30 18:38:33.391664 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 492/991] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:33 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:38:33.863629 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-45ae9010-a083-4538-8091-a4f17b239797 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:33.864234 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-45ae9010-a083-4538-8091-a4f17b239797 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:33.871648 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-45ae9010-a083-4538-8091-a4f17b239797 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:33.872094 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-45ae9010-a083-4538-8091-a4f17b239797 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:33.872856 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-45ae9010-a083-4538-8091-a4f17b239797 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:33.873291 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-45ae9010-a083-4538-8091-a4f17b239797 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:34.003447 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-45ae9010-a083-4538-8091-a4f17b239797 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:34.011966 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-45ae9010-a083-4538-8091-a4f17b239797 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:34.013440 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-45ae9010-a083-4538-8091-a4f17b239797 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:34.014605 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-45ae9010-a083-4538-8091-a4f17b239797 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1718 microversion: 2.20 time: 0.155040 Jun 30 18:38:34.015158 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 500/992] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:38:33 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1718 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:38:34.407845 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-fedb9949-117c-447e-85de-78428bd9ddd0 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:34.408435 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-fedb9949-117c-447e-85de-78428bd9ddd0 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:34.416076 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fedb9949-117c-447e-85de-78428bd9ddd0 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:34.416790 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fedb9949-117c-447e-85de-78428bd9ddd0 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:34.417590 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fedb9949-117c-447e-85de-78428bd9ddd0 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:34.418108 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fedb9949-117c-447e-85de-78428bd9ddd0 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:34.551161 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-fedb9949-117c-447e-85de-78428bd9ddd0 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784fdfd56b3d4ae4b6f68b66c4f06ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666edd3825ba4e32ac180ed230d93e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:34.559745 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-fedb9949-117c-447e-85de-78428bd9ddd0 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 200 len: 1358 microversion: 2.1 time: 0.155794 Jun 30 18:38:34.560303 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 493/993] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:34 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:38:35.576274 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-5bae8d66-b615-47f2-8d84-6fc4569e1e05 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:35.576877 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-5bae8d66-b615-47f2-8d84-6fc4569e1e05 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:35.583399 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-5bae8d66-b615-47f2-8d84-6fc4569e1e05 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:35.583845 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-5bae8d66-b615-47f2-8d84-6fc4569e1e05 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:35.585553 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-5bae8d66-b615-47f2-8d84-6fc4569e1e05 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:35.586008 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-5bae8d66-b615-47f2-8d84-6fc4569e1e05 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:35.722640 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-5bae8d66-b615-47f2-8d84-6fc4569e1e05 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784fdfd56b3d4ae4b6f68b66c4f06ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666edd3825ba4e32ac180ed230d93e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:35.725408 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell1:SELECT=100 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:38:35.731788 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-5bae8d66-b615-47f2-8d84-6fc4569e1e05 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 200 len: 1358 microversion: 2.1 time: 0.159283 Jun 30 18:38:35.732366 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 501/994] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:35 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:38:36.749065 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-7776135a-656d-437b-84f2-e5364fcf6ff8 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:36.749632 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-7776135a-656d-437b-84f2-e5364fcf6ff8 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:36.756559 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7776135a-656d-437b-84f2-e5364fcf6ff8 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:36.756990 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7776135a-656d-437b-84f2-e5364fcf6ff8 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:36.757927 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7776135a-656d-437b-84f2-e5364fcf6ff8 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:36.758320 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7776135a-656d-437b-84f2-e5364fcf6ff8 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:36.889358 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-7776135a-656d-437b-84f2-e5364fcf6ff8 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784fdfd56b3d4ae4b6f68b66c4f06ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666edd3825ba4e32ac180ed230d93e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:36.897298 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-7776135a-656d-437b-84f2-e5364fcf6ff8 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 200 len: 1358 microversion: 2.1 time: 0.152121 Jun 30 18:38:36.897876 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 494/995] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:36 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:38:37.265432 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-e8d02671-ae86-4ab3-a905-491ffb76d687 req-dc6f3c67-e027-4c4a-a2a1-ad6de9e363e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4a22a51-62b8-4ad0-88e4-f959b6cc606f", "name": "network-vif-plugged", "status": "completed", "tag": "66b87a68-1890-42c6-b759-72e44f506ff1"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:38:37.273627 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-e8d02671-ae86-4ab3-a905-491ffb76d687 req-dc6f3c67-e027-4c4a-a2a1-ad6de9e363e7 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:37.274061 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-e8d02671-ae86-4ab3-a905-491ffb76d687 req-dc6f3c67-e027-4c4a-a2a1-ad6de9e363e7 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:37.287220 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.compute.server_external_events [req-e8d02671-ae86-4ab3-a905-491ffb76d687 req-dc6f3c67-e027-4c4a-a2a1-ad6de9e363e7 service nova] Creating event network-vif-plugged:66b87a68-1890-42c6-b759-72e44f506ff1 for instance c4a22a51-62b8-4ad0-88e4-f959b6cc606f on hv-cinder-80378 Jun 30 18:38:37.292128 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-e8d02671-ae86-4ab3-a905-491ffb76d687 req-dc6f3c67-e027-4c4a-a2a1-ad6de9e363e7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030453 Jun 30 18:38:37.292905 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 502/996] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:38:37.914685 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-aac9bbac-6955-4f02-a948-6b5881487c35 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:37.915216 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-aac9bbac-6955-4f02-a948-6b5881487c35 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:37.921469 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-aac9bbac-6955-4f02-a948-6b5881487c35 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:37.921937 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-aac9bbac-6955-4f02-a948-6b5881487c35 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:37.922684 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-aac9bbac-6955-4f02-a948-6b5881487c35 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:37.923108 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-aac9bbac-6955-4f02-a948-6b5881487c35 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:38.054262 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-aac9bbac-6955-4f02-a948-6b5881487c35 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784fdfd56b3d4ae4b6f68b66c4f06ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666edd3825ba4e32ac180ed230d93e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:38.061405 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-aac9bbac-6955-4f02-a948-6b5881487c35 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 200 len: 1358 microversion: 2.1 time: 0.151443 Jun 30 18:38:38.061996 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 495/997] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:37 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:38:39.078724 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-80cae14c-ae05-4c10-9f85-b6471dcca297 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:39.079422 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-80cae14c-ae05-4c10-9f85-b6471dcca297 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:39.086338 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-80cae14c-ae05-4c10-9f85-b6471dcca297 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:39.086784 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-80cae14c-ae05-4c10-9f85-b6471dcca297 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:39.087541 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-80cae14c-ae05-4c10-9f85-b6471dcca297 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:39.087979 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-80cae14c-ae05-4c10-9f85-b6471dcca297 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:39.218683 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-80cae14c-ae05-4c10-9f85-b6471dcca297 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784fdfd56b3d4ae4b6f68b66c4f06ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666edd3825ba4e32ac180ed230d93e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:39.226766 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-80cae14c-ae05-4c10-9f85-b6471dcca297 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 200 len: 1358 microversion: 2.1 time: 0.152262 Jun 30 18:38:39.227324 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 503/998] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:39 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:38:40.243935 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-92ed76ab-ed66-4a73-bc7e-e0ddc02c4196 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:40.244544 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-92ed76ab-ed66-4a73-bc7e-e0ddc02c4196 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:40.251057 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-92ed76ab-ed66-4a73-bc7e-e0ddc02c4196 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:40.251501 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-92ed76ab-ed66-4a73-bc7e-e0ddc02c4196 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:40.252260 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-92ed76ab-ed66-4a73-bc7e-e0ddc02c4196 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:40.252696 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-92ed76ab-ed66-4a73-bc7e-e0ddc02c4196 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:40.271936 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell1:SELECT=100 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:38:40.383426 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-92ed76ab-ed66-4a73-bc7e-e0ddc02c4196 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784fdfd56b3d4ae4b6f68b66c4f06ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666edd3825ba4e32ac180ed230d93e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:40.390787 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-92ed76ab-ed66-4a73-bc7e-e0ddc02c4196 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 200 len: 1548 microversion: 2.1 time: 0.150708 Jun 30 18:38:40.391346 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 496/999] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:40 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:38:40.407240 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-0127e8b7-2c2a-479f-95b0-c3fa9d4ad711 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:40.407841 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-0127e8b7-2c2a-479f-95b0-c3fa9d4ad711 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:40.414813 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0127e8b7-2c2a-479f-95b0-c3fa9d4ad711 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:40.415254 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0127e8b7-2c2a-479f-95b0-c3fa9d4ad711 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:40.416002 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0127e8b7-2c2a-479f-95b0-c3fa9d4ad711 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:40.416429 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0127e8b7-2c2a-479f-95b0-c3fa9d4ad711 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:40.549488 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-0127e8b7-2c2a-479f-95b0-c3fa9d4ad711 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784fdfd56b3d4ae4b6f68b66c4f06ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666edd3825ba4e32ac180ed230d93e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:40.558061 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-0127e8b7-2c2a-479f-95b0-c3fa9d4ad711 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 200 len: 1548 microversion: 2.1 time: 0.154526 Jun 30 18:38:40.558810 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 504/1000] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:40 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:38:40.573807 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-d99be278-41ab-4bd4-8945-6c29aa832903 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:40.577146 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-d99be278-41ab-4bd4-8945-6c29aa832903 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '784fdfd56b3d4ae4b6f68b66c4f06ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666edd3825ba4e32ac180ed230d93e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:40.577923 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-d99be278-41ab-4bd4-8945-6c29aa832903 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Searching by: {'deleted': False, 'project_id': '666edd3825ba4e32ac180ed230d93e85'} {{(pid=117940) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 30 18:38:40.584611 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d99be278-41ab-4bd4-8945-6c29aa832903 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:40.584986 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d99be278-41ab-4bd4-8945-6c29aa832903 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:40.585805 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d99be278-41ab-4bd4-8945-6c29aa832903 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:40.586263 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d99be278-41ab-4bd4-8945-6c29aa832903 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:40.674019 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.multi_cell_list [None req-d99be278-41ab-4bd4-8945-6c29aa832903 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117940) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 30 18:38:40.766834 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-d99be278-41ab-4bd4-8945-6c29aa832903 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.196817 Jun 30 18:38:40.767405 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 497/1001] 10.222.0.33 () {58 vars in 1124 bytes} [Thu Jun 30 18:38:40 2022] GET /compute/v2.1/servers => generated 342 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:38:40.778333 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-c0fd6add-dd9a-4f42-bb8c-a3a65234401a tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:40.778950 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-c0fd6add-dd9a-4f42-bb8c-a3a65234401a tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:40.784969 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c0fd6add-dd9a-4f42-bb8c-a3a65234401a tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:40.785416 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c0fd6add-dd9a-4f42-bb8c-a3a65234401a tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:40.786404 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c0fd6add-dd9a-4f42-bb8c-a3a65234401a tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:40.786832 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c0fd6add-dd9a-4f42-bb8c-a3a65234401a tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:40.915119 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-c0fd6add-dd9a-4f42-bb8c-a3a65234401a tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784fdfd56b3d4ae4b6f68b66c4f06ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666edd3825ba4e32ac180ed230d93e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:40.922492 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-c0fd6add-dd9a-4f42-bb8c-a3a65234401a tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 200 len: 1548 microversion: 2.1 time: 0.148041 Jun 30 18:38:40.923037 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 505/1002] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:40 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:38:42.435817 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-78d0b83a-362f-416b-95af-c7ba05409d6a tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc0e93d6-bc1e-4978-9c43-1511667bb441"}} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:38:42.436874 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-78d0b83a-362f-416b-95af-c7ba05409d6a tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:42.444122 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-78d0b83a-362f-416b-95af-c7ba05409d6a tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:42.444569 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-78d0b83a-362f-416b-95af-c7ba05409d6a tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:42.445328 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-78d0b83a-362f-416b-95af-c7ba05409d6a tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:42.445795 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-78d0b83a-362f-416b-95af-c7ba05409d6a tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:42.703348 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-78d0b83a-362f-416b-95af-c7ba05409d6a tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "POST /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271344 Jun 30 18:38:42.704133 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 498/1003] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 30 18:38:42 2022] POST /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:38:47.388267 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-88ee956e-a937-47bb-af20-9d6a28f835c1 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:47.388870 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-88ee956e-a937-47bb-af20-9d6a28f835c1 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: a70367a4-54b1-405e-9b10-5356217349d4] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:47.395316 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-88ee956e-a937-47bb-af20-9d6a28f835c1 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:47.396362 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-88ee956e-a937-47bb-af20-9d6a28f835c1 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:47.397122 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-88ee956e-a937-47bb-af20-9d6a28f835c1 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:47.397549 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-88ee956e-a937-47bb-af20-9d6a28f835c1 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:47.419775 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-88ee956e-a937-47bb-af20-9d6a28f835c1 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4/ips" status: 200 len: 145 microversion: 2.1 time: 0.035442 Jun 30 18:38:47.420328 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 506/1004] 10.222.0.33 () {58 vars in 1247 bytes} [Thu Jun 30 18:38:47 2022] GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4/ips => generated 145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:38:48.741315 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-da112ee6-a3ba-481c-9e96-5718532a4b0b tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "964d8197-685e-401e-b0c4-069ca91af044"}} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:38:48.742554 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-da112ee6-a3ba-481c-9e96-5718532a4b0b tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: a70367a4-54b1-405e-9b10-5356217349d4] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:48.749389 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-da112ee6-a3ba-481c-9e96-5718532a4b0b tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:48.749874 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-da112ee6-a3ba-481c-9e96-5718532a4b0b tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:48.750635 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-da112ee6-a3ba-481c-9e96-5718532a4b0b tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:48.751073 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-da112ee6-a3ba-481c-9e96-5718532a4b0b tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:49.803380 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-da112ee6-a3ba-481c-9e96-5718532a4b0b tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "POST /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.066467 Jun 30 18:38:49.804194 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 499/1005] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 30 18:38:48 2022] POST /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4/os-volume_attachments => generated 194 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:38:50.229534 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-c61a6772-d35d-428f-ba16-351992969930 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:50.230261 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-c61a6772-d35d-428f-ba16-351992969930 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:50.236768 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c61a6772-d35d-428f-ba16-351992969930 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:50.237171 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c61a6772-d35d-428f-ba16-351992969930 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:50.237948 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c61a6772-d35d-428f-ba16-351992969930 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:50.238391 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c61a6772-d35d-428f-ba16-351992969930 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:50.370743 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-c61a6772-d35d-428f-ba16-351992969930 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784fdfd56b3d4ae4b6f68b66c4f06ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666edd3825ba4e32ac180ed230d93e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:50.378619 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-c61a6772-d35d-428f-ba16-351992969930 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 200 len: 1594 microversion: 2.1 time: 0.152862 Jun 30 18:38:50.379874 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 507/1006] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:50 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 1594 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:38:52.038999 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell0:SELECT=2 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:38:52.043521 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [req-361b9dda-a4e0-4249-866b-c36a8e191245 req-b6f135d5-9c72-45c6-9361-205b83589c2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4a22a51-62b8-4ad0-88e4-f959b6cc606f", "tag": "66b87a68-1890-42c6-b759-72e44f506ff1"}]} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:38:52.053666 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-361b9dda-a4e0-4249-866b-c36a8e191245 req-b6f135d5-9c72-45c6-9361-205b83589c2d service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:52.054111 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-361b9dda-a4e0-4249-866b-c36a8e191245 req-b6f135d5-9c72-45c6-9361-205b83589c2d service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:52.068240 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.compute.server_external_events [req-361b9dda-a4e0-4249-866b-c36a8e191245 req-b6f135d5-9c72-45c6-9361-205b83589c2d service nova] Creating event network-changed:66b87a68-1890-42c6-b759-72e44f506ff1 for instance c4a22a51-62b8-4ad0-88e4-f959b6cc606f on hv-cinder-80378 Jun 30 18:38:52.074533 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [req-361b9dda-a4e0-4249-866b-c36a8e191245 req-b6f135d5-9c72-45c6-9361-205b83589c2d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036823 Jun 30 18:38:52.075842 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 500/1007] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:38:53.110631 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-83b9027b-e747-4b92-a61f-300a3c56c769 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1274187528"}} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:38:53.111166 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-83b9027b-e747-4b92-a61f-300a3c56c769 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:53.117975 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-83b9027b-e747-4b92-a61f-300a3c56c769 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:53.118421 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-83b9027b-e747-4b92-a61f-300a3c56c769 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:53.119188 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-83b9027b-e747-4b92-a61f-300a3c56c769 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:53.119618 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-83b9027b-e747-4b92-a61f-300a3c56c769 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:53.258171 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.network.security_group_api [None req-83b9027b-e747-4b92-a61f-300a3c56c769 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Adding security group 761808d1-901c-45dd-88c7-48f8dac98ece to port 66b87a68-1890-42c6-b759-72e44f506ff1 Jun 30 18:38:53.618999 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-83b9027b-e747-4b92-a61f-300a3c56c769 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "POST /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f/action" status: 202 len: 0 microversion: 2.1 time: 0.512192 Jun 30 18:38:53.623220 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 508/1008] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 30 18:38:53 2022] POST /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f/action => generated 0 bytes in 517 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 18:38:53.630366 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-61ebd41f-f1f0-43ea-b3a2-4fcd088a72df tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:53.637166 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-61ebd41f-f1f0-43ea-b3a2-4fcd088a72df tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:53.639287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_api:SELECT=36 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:38:53.646460 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-61ebd41f-f1f0-43ea-b3a2-4fcd088a72df tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:53.646868 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-61ebd41f-f1f0-43ea-b3a2-4fcd088a72df tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:53.647641 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-61ebd41f-f1f0-43ea-b3a2-4fcd088a72df tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:53.648284 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-61ebd41f-f1f0-43ea-b3a2-4fcd088a72df tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:53.803423 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-61ebd41f-f1f0-43ea-b3a2-4fcd088a72df tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784fdfd56b3d4ae4b6f68b66c4f06ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666edd3825ba4e32ac180ed230d93e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:53.811269 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-61ebd41f-f1f0-43ea-b3a2-4fcd088a72df tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 200 len: 1760 microversion: 2.1 time: 0.187055 Jun 30 18:38:53.812169 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 501/1009] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:53 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 1760 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:38:54.091853 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-76807a3f-f8c6-453c-aa16-ce64e3cb95ce req-2f063b69-1b83-439b-8345-ae6d36b27df4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4a22a51-62b8-4ad0-88e4-f959b6cc606f", "tag": "66b87a68-1890-42c6-b759-72e44f506ff1"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:38:54.095641 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_api:SELECT=36 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:38:54.106036 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-76807a3f-f8c6-453c-aa16-ce64e3cb95ce req-2f063b69-1b83-439b-8345-ae6d36b27df4 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:54.106483 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-76807a3f-f8c6-453c-aa16-ce64e3cb95ce req-2f063b69-1b83-439b-8345-ae6d36b27df4 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:54.118332 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.compute.server_external_events [req-76807a3f-f8c6-453c-aa16-ce64e3cb95ce req-2f063b69-1b83-439b-8345-ae6d36b27df4 service nova] Creating event network-changed:66b87a68-1890-42c6-b759-72e44f506ff1 for instance c4a22a51-62b8-4ad0-88e4-f959b6cc606f on hv-cinder-80378 Jun 30 18:38:54.123296 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-76807a3f-f8c6-453c-aa16-ce64e3cb95ce req-2f063b69-1b83-439b-8345-ae6d36b27df4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035603 Jun 30 18:38:54.123889 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 509/1010] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:38:57.325783 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-9dd788ba-442c-4c22-b9fc-924beb84ba52 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:57.326779 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-9dd788ba-442c-4c22-b9fc-924beb84ba52 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: a70367a4-54b1-405e-9b10-5356217349d4] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:57.333569 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9dd788ba-442c-4c22-b9fc-924beb84ba52 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:57.334037 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9dd788ba-442c-4c22-b9fc-924beb84ba52 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:57.334786 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9dd788ba-442c-4c22-b9fc-924beb84ba52 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:57.335211 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9dd788ba-442c-4c22-b9fc-924beb84ba52 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:57.363716 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-9dd788ba-442c-4c22-b9fc-924beb84ba52 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041845 Jun 30 18:38:57.364258 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 502/1011] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 30 18:38:57 2022] GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:38:57.374822 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-1af639da-2707-46b8-b8c7-ab3d46542b71 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:57.375415 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-1af639da-2707-46b8-b8c7-ab3d46542b71 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: a70367a4-54b1-405e-9b10-5356217349d4] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:57.381490 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1af639da-2707-46b8-b8c7-ab3d46542b71 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:57.381965 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1af639da-2707-46b8-b8c7-ab3d46542b71 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:57.382706 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1af639da-2707-46b8-b8c7-ab3d46542b71 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:57.383131 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1af639da-2707-46b8-b8c7-ab3d46542b71 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:57.413478 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-1af639da-2707-46b8-b8c7-ab3d46542b71 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4/os-volume_attachments/964d8197-685e-401e-b0c4-069ca91af044" status: 200 len: 194 microversion: 2.1 time: 0.043260 Jun 30 18:38:57.414086 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 510/1012] 10.222.0.33 () {58 vars in 1412 bytes} [Thu Jun 30 18:38:57 2022] GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4/os-volume_attachments/964d8197-685e-401e-b0c4-069ca91af044 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:38:58.735924 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-fcfc4a29-dad4-4fbf-bfb7-489dac10c0f8 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "478010a6-352d-4ef8-8431-ae802d2118ba"}} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:38:58.737660 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-fcfc4a29-dad4-4fbf-bfb7-489dac10c0f8 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: a70367a4-54b1-405e-9b10-5356217349d4] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:58.744020 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fcfc4a29-dad4-4fbf-bfb7-489dac10c0f8 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:58.744468 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fcfc4a29-dad4-4fbf-bfb7-489dac10c0f8 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:58.745233 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fcfc4a29-dad4-4fbf-bfb7-489dac10c0f8 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:58.745698 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fcfc4a29-dad4-4fbf-bfb7-489dac10c0f8 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:59.006972 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-fcfc4a29-dad4-4fbf-bfb7-489dac10c0f8 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "POST /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274806 Jun 30 18:38:59.007592 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 503/1013] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 30 18:38:58 2022] POST /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:39:06.492158 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-5f2fbdcd-3f53-4866-a8f7-7c92d062089e tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:39:06.493101 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-5f2fbdcd-3f53-4866-a8f7-7c92d062089e tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: a70367a4-54b1-405e-9b10-5356217349d4] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:39:06.500687 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-5f2fbdcd-3f53-4866-a8f7-7c92d062089e tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:06.501119 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-5f2fbdcd-3f53-4866-a8f7-7c92d062089e tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:06.501911 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-5f2fbdcd-3f53-4866-a8f7-7c92d062089e tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:06.502344 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-5f2fbdcd-3f53-4866-a8f7-7c92d062089e tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:06.531619 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-5f2fbdcd-3f53-4866-a8f7-7c92d062089e tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042970 Jun 30 18:39:06.532173 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 511/1014] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 30 18:39:06 2022] GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:39:06.677263 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-081a30b9-2590-41aa-a266-95a4e0ec9e0e tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:39:06.677892 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-081a30b9-2590-41aa-a266-95a4e0ec9e0e tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: a70367a4-54b1-405e-9b10-5356217349d4] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:39:06.684255 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-081a30b9-2590-41aa-a266-95a4e0ec9e0e tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:06.684704 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-081a30b9-2590-41aa-a266-95a4e0ec9e0e tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:06.685496 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-081a30b9-2590-41aa-a266-95a4e0ec9e0e tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:06.685978 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-081a30b9-2590-41aa-a266-95a4e0ec9e0e tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:06.714094 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-081a30b9-2590-41aa-a266-95a4e0ec9e0e tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4/os-volume_attachments/964d8197-685e-401e-b0c4-069ca91af044" status: 200 len: 194 microversion: 2.1 time: 0.042425 Jun 30 18:39:06.714822 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 504/1015] 10.222.0.33 () {58 vars in 1412 bytes} [Thu Jun 30 18:39:06 2022] GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4/os-volume_attachments/964d8197-685e-401e-b0c4-069ca91af044 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:39:06.724857 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-11050254-6bf0-40f4-ba1e-372f16879ce3 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:39:06.725353 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-11050254-6bf0-40f4-ba1e-372f16879ce3 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: a70367a4-54b1-405e-9b10-5356217349d4] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:39:06.731571 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-11050254-6bf0-40f4-ba1e-372f16879ce3 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:06.732021 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-11050254-6bf0-40f4-ba1e-372f16879ce3 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:06.732790 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-11050254-6bf0-40f4-ba1e-372f16879ce3 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:06.733230 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-11050254-6bf0-40f4-ba1e-372f16879ce3 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:06.814692 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.objects.instance [None req-11050254-6bf0-40f4-ba1e-372f16879ce3 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lazy-loading 'services' on Instance uuid a70367a4-54b1-405e-9b10-5356217349d4 {{(pid=117941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 18:39:06.887401 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-11050254-6bf0-40f4-ba1e-372f16879ce3 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4/os-volume_attachments/964d8197-685e-401e-b0c4-069ca91af044" status: 202 len: 0 microversion: 2.1 time: 0.166267 Jun 30 18:39:06.888080 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 512/1016] 10.222.0.33 () {58 vars in 1415 bytes} [Thu Jun 30 18:39:06 2022] DELETE /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4/os-volume_attachments/964d8197-685e-401e-b0c4-069ca91af044 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 18:39:09.060823 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-3603b903-8d80-4f24-8356-0f1d9c107ca2 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:39:09.061347 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-3603b903-8d80-4f24-8356-0f1d9c107ca2 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: a70367a4-54b1-405e-9b10-5356217349d4] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:39:09.068454 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3603b903-8d80-4f24-8356-0f1d9c107ca2 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:09.068901 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3603b903-8d80-4f24-8356-0f1d9c107ca2 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:09.069704 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3603b903-8d80-4f24-8356-0f1d9c107ca2 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:09.070134 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3603b903-8d80-4f24-8356-0f1d9c107ca2 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:09.099458 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-3603b903-8d80-4f24-8356-0f1d9c107ca2 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4/os-volume_attachments/478010a6-352d-4ef8-8431-ae802d2118ba" status: 200 len: 194 microversion: 2.1 time: 0.042551 Jun 30 18:39:09.100044 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 505/1017] 10.222.0.33 () {58 vars in 1412 bytes} [Thu Jun 30 18:39:09 2022] GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4/os-volume_attachments/478010a6-352d-4ef8-8431-ae802d2118ba => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:39:09.111978 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-3ab2c008-1168-49de-9546-a55a90f9232a tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:39:09.112554 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-3ab2c008-1168-49de-9546-a55a90f9232a tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: a70367a4-54b1-405e-9b10-5356217349d4] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:39:09.118681 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3ab2c008-1168-49de-9546-a55a90f9232a tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:09.119122 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3ab2c008-1168-49de-9546-a55a90f9232a tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:09.119869 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3ab2c008-1168-49de-9546-a55a90f9232a tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:09.120297 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3ab2c008-1168-49de-9546-a55a90f9232a tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:09.122834 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=1 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:39:09.201443 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.objects.instance [None req-3ab2c008-1168-49de-9546-a55a90f9232a tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lazy-loading 'services' on Instance uuid a70367a4-54b1-405e-9b10-5356217349d4 {{(pid=117941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 18:39:09.273374 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-3ab2c008-1168-49de-9546-a55a90f9232a tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4/os-volume_attachments/478010a6-352d-4ef8-8431-ae802d2118ba" status: 202 len: 0 microversion: 2.1 time: 0.167281 Jun 30 18:39:09.273986 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 513/1018] 10.222.0.33 () {58 vars in 1415 bytes} [Thu Jun 30 18:39:09 2022] DELETE /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4/os-volume_attachments/478010a6-352d-4ef8-8431-ae802d2118ba => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 18:39:10.428408 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-311416e3-0b63-4547-891e-9e4ff4602934 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:39:10.429336 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-311416e3-0b63-4547-891e-9e4ff4602934 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: a70367a4-54b1-405e-9b10-5356217349d4] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:39:10.435705 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-311416e3-0b63-4547-891e-9e4ff4602934 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:10.436768 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-311416e3-0b63-4547-891e-9e4ff4602934 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:10.437539 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-311416e3-0b63-4547-891e-9e4ff4602934 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:10.438000 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-311416e3-0b63-4547-891e-9e4ff4602934 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:10.440419 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:39:10.468422 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-311416e3-0b63-4547-891e-9e4ff4602934 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044016 Jun 30 18:39:10.468974 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 506/1019] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 30 18:39:10 2022] GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 18:39:10.578064 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-efbd93d5-ce97-4ee6-a925-ee8a645d5f28 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:39:10.579169 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-efbd93d5-ce97-4ee6-a925-ee8a645d5f28 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: a70367a4-54b1-405e-9b10-5356217349d4] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:39:10.585702 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-efbd93d5-ce97-4ee6-a925-ee8a645d5f28 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:10.586091 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-efbd93d5-ce97-4ee6-a925-ee8a645d5f28 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:10.586850 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-efbd93d5-ce97-4ee6-a925-ee8a645d5f28 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:10.587279 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-efbd93d5-ce97-4ee6-a925-ee8a645d5f28 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:10.616567 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-efbd93d5-ce97-4ee6-a925-ee8a645d5f28 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044485 Jun 30 18:39:10.617110 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 514/1020] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 30 18:39:10 2022] GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 18:39:10.673180 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-8c9a0d63-5bdd-4a42-a07e-b2c90f4ef413 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:39:10.673802 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-8c9a0d63-5bdd-4a42-a07e-b2c90f4ef413 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: a70367a4-54b1-405e-9b10-5356217349d4] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:39:10.679948 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8c9a0d63-5bdd-4a42-a07e-b2c90f4ef413 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:10.680390 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8c9a0d63-5bdd-4a42-a07e-b2c90f4ef413 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:10.681130 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8c9a0d63-5bdd-4a42-a07e-b2c90f4ef413 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:10.681558 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8c9a0d63-5bdd-4a42-a07e-b2c90f4ef413 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:10.706448 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-8c9a0d63-5bdd-4a42-a07e-b2c90f4ef413 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: a70367a4-54b1-405e-9b10-5356217349d4] Going to try to terminate instance {{(pid=117940) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 18:39:10.779512 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-8c9a0d63-5bdd-4a42-a07e-b2c90f4ef413 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4" status: 204 len: 0 microversion: 2.1 time: 0.109885 Jun 30 18:39:10.780210 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 507/1021] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 30 18:39:10 2022] DELETE /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 18:39:10.788617 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-fd941f50-eb55-47f0-a6d4-505291c33653 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:39:10.789282 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-fd941f50-eb55-47f0-a6d4-505291c33653 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: a70367a4-54b1-405e-9b10-5356217349d4] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:39:10.796183 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fd941f50-eb55-47f0-a6d4-505291c33653 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:10.796643 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fd941f50-eb55-47f0-a6d4-505291c33653 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:10.797390 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fd941f50-eb55-47f0-a6d4-505291c33653 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:10.797847 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fd941f50-eb55-47f0-a6d4-505291c33653 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:10.926542 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-fd941f50-eb55-47f0-a6d4-505291c33653 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:39:10.933953 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-fd941f50-eb55-47f0-a6d4-505291c33653 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4" status: 200 len: 1674 microversion: 2.1 time: 0.149158 Jun 30 18:39:10.934513 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 515/1022] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:39:10 2022] GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4 => generated 1674 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:39:11.953289 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-eb5e0271-d672-47a5-964a-d5e8888ac4b2 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:39:11.953998 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-eb5e0271-d672-47a5-964a-d5e8888ac4b2 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: a70367a4-54b1-405e-9b10-5356217349d4] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:39:11.960615 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-eb5e0271-d672-47a5-964a-d5e8888ac4b2 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:11.961054 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-eb5e0271-d672-47a5-964a-d5e8888ac4b2 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:11.961821 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-eb5e0271-d672-47a5-964a-d5e8888ac4b2 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:11.962251 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-eb5e0271-d672-47a5-964a-d5e8888ac4b2 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:12.097736 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-eb5e0271-d672-47a5-964a-d5e8888ac4b2 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:39:12.105165 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-eb5e0271-d672-47a5-964a-d5e8888ac4b2 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4" status: 200 len: 1674 microversion: 2.1 time: 0.156961 Jun 30 18:39:12.105763 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 508/1023] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:39:11 2022] GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4 => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:39:13.121775 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-1f11c566-9b0a-4324-8cbd-af7df711c069 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:39:13.122383 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-1f11c566-9b0a-4324-8cbd-af7df711c069 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: a70367a4-54b1-405e-9b10-5356217349d4] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:39:13.129052 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1f11c566-9b0a-4324-8cbd-af7df711c069 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:13.129496 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1f11c566-9b0a-4324-8cbd-af7df711c069 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:13.130301 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1f11c566-9b0a-4324-8cbd-af7df711c069 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:13.130731 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1f11c566-9b0a-4324-8cbd-af7df711c069 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:13.272570 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-1f11c566-9b0a-4324-8cbd-af7df711c069 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:39:13.280827 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-1f11c566-9b0a-4324-8cbd-af7df711c069 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4" status: 200 len: 1674 microversion: 2.1 time: 0.162828 Jun 30 18:39:13.281533 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 516/1024] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:39:13 2022] GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4 => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:39:13.822707 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [req-b38aa171-2d1b-4291-9014-2fe5ee88b69a req-043f192f-e6e2-4059-88d3-fc0105dee5aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a70367a4-54b1-405e-9b10-5356217349d4", "name": "network-vif-deleted", "tag": "1664f24e-d445-414c-9bb0-934bafacdaa9"}]} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:39:13.832884 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-b38aa171-2d1b-4291-9014-2fe5ee88b69a req-043f192f-e6e2-4059-88d3-fc0105dee5aa service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:13.833315 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-b38aa171-2d1b-4291-9014-2fe5ee88b69a req-043f192f-e6e2-4059-88d3-fc0105dee5aa service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:13.846225 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.compute.server_external_events [req-b38aa171-2d1b-4291-9014-2fe5ee88b69a req-043f192f-e6e2-4059-88d3-fc0105dee5aa service nova] Creating event network-vif-deleted:1664f24e-d445-414c-9bb0-934bafacdaa9 for instance a70367a4-54b1-405e-9b10-5356217349d4 on hv-cinder-80378 Jun 30 18:39:13.852336 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [req-b38aa171-2d1b-4291-9014-2fe5ee88b69a req-043f192f-e6e2-4059-88d3-fc0105dee5aa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033688 Jun 30 18:39:13.852941 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 509/1025] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:39:14.298380 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-9c6156e2-9fec-4335-83cb-37d4b044062e tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:39:14.299003 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-9c6156e2-9fec-4335-83cb-37d4b044062e tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: a70367a4-54b1-405e-9b10-5356217349d4] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:39:14.305504 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9c6156e2-9fec-4335-83cb-37d4b044062e tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:14.306306 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9c6156e2-9fec-4335-83cb-37d4b044062e tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:14.307072 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9c6156e2-9fec-4335-83cb-37d4b044062e tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:14.307522 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9c6156e2-9fec-4335-83cb-37d4b044062e tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:14.339863 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9c6156e2-9fec-4335-83cb-37d4b044062e tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:14.340794 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9c6156e2-9fec-4335-83cb-37d4b044062e tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:14.342021 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.objects.instance [None req-9c6156e2-9fec-4335-83cb-37d4b044062e tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lazy-loading 'fault' on Instance uuid a70367a4-54b1-405e-9b10-5356217349d4 {{(pid=117941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 18:39:14.391234 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-9c6156e2-9fec-4335-83cb-37d4b044062e tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac4fc6cab4f47ea910ffdbed0a8e5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f04296b43b69e675de14cf1a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:39:14.399118 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-9c6156e2-9fec-4335-83cb-37d4b044062e tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4" status: 200 len: 1328 microversion: 2.1 time: 0.105509 Jun 30 18:39:14.399688 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 517/1026] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:39:14 2022] GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4 => generated 1328 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:39:15.417675 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-398a502d-6ac8-4de8-ae18-d1a55f5f6376 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:39:15.418314 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-398a502d-6ac8-4de8-ae18-d1a55f5f6376 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: a70367a4-54b1-405e-9b10-5356217349d4] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:39:15.426140 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-398a502d-6ac8-4de8-ae18-d1a55f5f6376 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:15.426591 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-398a502d-6ac8-4de8-ae18-d1a55f5f6376 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:15.427351 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-398a502d-6ac8-4de8-ae18-d1a55f5f6376 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:15.427787 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-398a502d-6ac8-4de8-ae18-d1a55f5f6376 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:15.440790 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.wsgi [None req-398a502d-6ac8-4de8-ae18-d1a55f5f6376 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] HTTP exception thrown: Instance a70367a4-54b1-405e-9b10-5356217349d4 could not be found. Jun 30 18:39:15.442453 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-398a502d-6ac8-4de8-ae18-d1a55f5f6376 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Request method failure captured: Jun 30 18:39:15.442453 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: request: GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4 HTTP/1.1 Jun 30 18:39:15.442453 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept: application/json Jun 30 18:39:15.442453 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept-Encoding: identity Jun 30 18:39:15.442453 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Connection: close Jun 30 18:39:15.442453 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Length: 0 Jun 30 18:39:15.442453 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Type: application/json Jun 30 18:39:15.442453 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Host: 10.222.0.33 Jun 30 18:39:15.442453 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Openstack-System-Scope: None Jun 30 18:39:15.442453 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: User-Agent: python-urllib3/1.26.9 Jun 30 18:39:15.442453 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Auth-Token: gAAAAABiveuuH82i-YLb0OxxVVWp1NwpPb1owgHQi2P6swgIWmFgaFrviBufDQYdbB4_ZJTyaS1yL1Yy1WvXsovGI8Vb1kizrvRZjFWwQUkCVIL9AVVBKtPi4Sls33Errw5DIRH3Ni4zFX1q97gGxYDGT_fbMT-kNhddd0rI6myqLPYdXJvya4U Jun 30 18:39:15.442453 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Id: None Jun 30 18:39:15.442453 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Name: None Jun 30 18:39:15.442453 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Identity-Status: Confirmed Jun 30 18:39:15.442453 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Is-Admin-Project: True Jun 30 18:39:15.442453 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Id: default Jun 30 18:39:15.442453 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Name: Default Jun 30 18:39:15.442453 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Id: 76384f04296b43b69e675de14cf1a55a Jun 30 18:39:15.442453 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Name: tempest-AttachVolumeTestJSON-1612416413 Jun 30 18:39:15.442453 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Role: reader,member Jun 30 18:39:15.442453 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Roles: reader,member Jun 30 18:39:15.444209 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/76384f04296b43b69e675de14cf1a55a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_76384f04296b43b69e675de14cf1a55a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/76384f04296b43b69e675de14cf1a55a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/76384f04296b43b69e675de14cf1a55a"}]}] Jun 30 18:39:15.444209 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant: tempest-AttachVolumeTestJSON-1612416413 Jun 30 18:39:15.444209 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Id: 76384f04296b43b69e675de14cf1a55a Jun 30 18:39:15.444209 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1612416413 Jun 30 18:39:15.444209 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User: tempest-AttachVolumeTestJSON-1612416413-project Jun 30 18:39:15.444209 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Id: default Jun 30 18:39:15.444209 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Name: Default Jun 30 18:39:15.444209 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Id: 6ac4fc6cab4f47ea910ffdbed0a8e5b8 Jun 30 18:39:15.444209 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Name: tempest-AttachVolumeTestJSON-1612416413-project Jun 30 18:39:15.444209 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: method: > Jun 30 18:39:15.444209 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: exception: Instance a70367a4-54b1-405e-9b10-5356217349d4 could not be found. Jun 30 18:39:15.444209 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: action_args: {'id': 'a70367a4-54b1-405e-9b10-5356217349d4'} Jun 30 18:39:15.445191 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:39:15.445191 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:39:15.445191 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:39:15.445191 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:39:15.445191 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:39:15.445191 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:39:15.445191 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:39:15.445191 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:39:15.445191 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:39:15.445191 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:39:15.445191 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a70367a4-54b1-405e-9b10-5356217349d4 could not be found. Jun 30 18:39:15.445191 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:39:15.445191 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:39:15.445191 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:39:15.445191 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:39:15.445191 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:39:15.445191 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:39:15.445191 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:39:15.445191 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:39:15.445191 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:39:15.446834 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:39:15.446834 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:39:15.446834 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:39:15.446834 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:39:15.446834 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:39:15.446834 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:39:15.446834 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:39:15.446834 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a70367a4-54b1-405e-9b10-5356217349d4 could not be found. Jun 30 18:39:15.446834 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:39:15.446834 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:39:15.446834 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:39:15.446834 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:39:15.446834 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:39:15.446834 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:39:15.446834 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:39:15.446834 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:39:15.446834 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a70367a4-54b1-405e-9b10-5356217349d4 could not be found. Jun 30 18:39:15.446834 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:39:15.448534 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-398a502d-6ac8-4de8-ae18-d1a55f5f6376 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Returning 404 to user: Instance a70367a4-54b1-405e-9b10-5356217349d4 could not be found. {{(pid=117940) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:39:15.448534 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-398a502d-6ac8-4de8-ae18-d1a55f5f6376 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4" status: 404 len: 111 microversion: 2.1 time: 0.030457 Jun 30 18:39:15.448534 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 510/1027] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:39:15 2022] GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:39:15.453111 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-bb5ae7e1-05e7-444c-bce1-5757a75a628b tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '.version_select at 0x7f1804d16700>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:39:15.456304 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bb5ae7e1-05e7-444c-bce1-5757a75a628b tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [41ed1994-e757-4a1a-bab0-0300d3308d83] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 30 18:39:16.464399 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO oslo.messaging._drivers.impl_rabbit [None req-bb5ae7e1-05e7-444c-bce1-5757a75a628b tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [41ed1994-e757-4a1a-bab0-0300d3308d83] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 43966. Jun 30 18:39:16.483890 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-bb5ae7e1-05e7-444c-bce1-5757a75a628b tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1198799414" status: 202 len: 0 microversion: 2.1 time: 1.035155 Jun 30 18:39:16.484482 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 518/1028] 10.222.0.33 () {58 vars in 1220 bytes} [Thu Jun 30 18:39:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1198799414 => generated 0 bytes in 1036 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 18:39:19.353735 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-298f2596-1e2d-4402-b16a-20632c8b8758 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:39:19.354251 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-298f2596-1e2d-4402-b16a-20632c8b8758 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: a70367a4-54b1-405e-9b10-5356217349d4] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:39:19.361459 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-298f2596-1e2d-4402-b16a-20632c8b8758 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:19.361938 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-298f2596-1e2d-4402-b16a-20632c8b8758 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:19.362694 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-298f2596-1e2d-4402-b16a-20632c8b8758 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:19.363127 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-298f2596-1e2d-4402-b16a-20632c8b8758 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:19.377038 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.wsgi [None req-298f2596-1e2d-4402-b16a-20632c8b8758 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] HTTP exception thrown: Instance a70367a4-54b1-405e-9b10-5356217349d4 could not be found. Jun 30 18:39:19.378583 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-298f2596-1e2d-4402-b16a-20632c8b8758 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Request method failure captured: Jun 30 18:39:19.378583 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: request: DELETE /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4 HTTP/1.1 Jun 30 18:39:19.378583 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept: application/json Jun 30 18:39:19.378583 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept-Encoding: identity Jun 30 18:39:19.378583 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Connection: close Jun 30 18:39:19.378583 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Length: 0 Jun 30 18:39:19.378583 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Type: application/json Jun 30 18:39:19.378583 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Host: 10.222.0.33 Jun 30 18:39:19.378583 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Openstack-System-Scope: None Jun 30 18:39:19.378583 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: User-Agent: python-urllib3/1.26.9 Jun 30 18:39:19.378583 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Auth-Token: gAAAAABiveuuH82i-YLb0OxxVVWp1NwpPb1owgHQi2P6swgIWmFgaFrviBufDQYdbB4_ZJTyaS1yL1Yy1WvXsovGI8Vb1kizrvRZjFWwQUkCVIL9AVVBKtPi4Sls33Errw5DIRH3Ni4zFX1q97gGxYDGT_fbMT-kNhddd0rI6myqLPYdXJvya4U Jun 30 18:39:19.378583 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Id: None Jun 30 18:39:19.378583 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Name: None Jun 30 18:39:19.378583 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Identity-Status: Confirmed Jun 30 18:39:19.378583 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Is-Admin-Project: True Jun 30 18:39:19.378583 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Id: default Jun 30 18:39:19.378583 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Name: Default Jun 30 18:39:19.378583 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Id: 76384f04296b43b69e675de14cf1a55a Jun 30 18:39:19.378583 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Name: tempest-AttachVolumeTestJSON-1612416413 Jun 30 18:39:19.378583 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Role: reader,member Jun 30 18:39:19.378583 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Roles: reader,member Jun 30 18:39:19.380276 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/76384f04296b43b69e675de14cf1a55a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_76384f04296b43b69e675de14cf1a55a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/76384f04296b43b69e675de14cf1a55a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/76384f04296b43b69e675de14cf1a55a"}]}] Jun 30 18:39:19.380276 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant: tempest-AttachVolumeTestJSON-1612416413 Jun 30 18:39:19.380276 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Id: 76384f04296b43b69e675de14cf1a55a Jun 30 18:39:19.380276 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1612416413 Jun 30 18:39:19.380276 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User: tempest-AttachVolumeTestJSON-1612416413-project Jun 30 18:39:19.380276 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Id: default Jun 30 18:39:19.380276 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Name: Default Jun 30 18:39:19.380276 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Id: 6ac4fc6cab4f47ea910ffdbed0a8e5b8 Jun 30 18:39:19.380276 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Name: tempest-AttachVolumeTestJSON-1612416413-project Jun 30 18:39:19.380276 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: method: > Jun 30 18:39:19.380276 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: exception: Instance a70367a4-54b1-405e-9b10-5356217349d4 could not be found. Jun 30 18:39:19.380276 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: action_args: {'id': 'a70367a4-54b1-405e-9b10-5356217349d4'} Jun 30 18:39:19.381191 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:39:19.381191 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:39:19.381191 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:39:19.381191 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:39:19.381191 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:39:19.381191 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:39:19.381191 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:39:19.381191 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:39:19.381191 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:39:19.381191 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:39:19.381191 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a70367a4-54b1-405e-9b10-5356217349d4 could not be found. Jun 30 18:39:19.381191 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:39:19.381191 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:39:19.381191 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:39:19.381191 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:39:19.381191 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:39:19.381191 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:39:19.381191 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:39:19.381191 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:39:19.381191 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:39:19.382885 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:39:19.382885 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 18:39:19.382885 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 18:39:19.382885 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 18:39:19.382885 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 18:39:19.382885 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:39:19.382885 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:39:19.382885 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:39:19.382885 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:39:19.382885 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a70367a4-54b1-405e-9b10-5356217349d4 could not be found. Jun 30 18:39:19.382885 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:39:19.382885 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:39:19.382885 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:39:19.382885 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:39:19.382885 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:39:19.382885 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:39:19.382885 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:39:19.382885 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:39:19.382885 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a70367a4-54b1-405e-9b10-5356217349d4 could not be found. Jun 30 18:39:19.382885 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:39:19.384490 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-298f2596-1e2d-4402-b16a-20632c8b8758 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Returning 404 to user: Instance a70367a4-54b1-405e-9b10-5356217349d4 could not be found. {{(pid=117940) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:39:19.384490 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-298f2596-1e2d-4402-b16a-20632c8b8758 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4" status: 404 len: 111 microversion: 2.1 time: 0.030089 Jun 30 18:39:19.384490 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 511/1029] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 30 18:39:19 2022] DELETE /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:39:19.389431 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-757d74c5-bbc3-45cd-9c71-1ad735620617 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:39:19.390095 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-757d74c5-bbc3-45cd-9c71-1ad735620617 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: a70367a4-54b1-405e-9b10-5356217349d4] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:39:19.396617 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-757d74c5-bbc3-45cd-9c71-1ad735620617 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:19.397060 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-757d74c5-bbc3-45cd-9c71-1ad735620617 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:19.397830 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-757d74c5-bbc3-45cd-9c71-1ad735620617 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:19.398261 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-757d74c5-bbc3-45cd-9c71-1ad735620617 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:19.411818 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.wsgi [None req-757d74c5-bbc3-45cd-9c71-1ad735620617 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] HTTP exception thrown: Instance a70367a4-54b1-405e-9b10-5356217349d4 could not be found. Jun 30 18:39:19.413440 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-757d74c5-bbc3-45cd-9c71-1ad735620617 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Request method failure captured: Jun 30 18:39:19.413440 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: request: GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4 HTTP/1.1 Jun 30 18:39:19.413440 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept: application/json Jun 30 18:39:19.413440 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept-Encoding: identity Jun 30 18:39:19.413440 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Connection: close Jun 30 18:39:19.413440 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Length: 0 Jun 30 18:39:19.413440 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Type: application/json Jun 30 18:39:19.413440 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Host: 10.222.0.33 Jun 30 18:39:19.413440 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Openstack-System-Scope: None Jun 30 18:39:19.413440 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: User-Agent: python-urllib3/1.26.9 Jun 30 18:39:19.413440 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Auth-Token: gAAAAABiveuuH82i-YLb0OxxVVWp1NwpPb1owgHQi2P6swgIWmFgaFrviBufDQYdbB4_ZJTyaS1yL1Yy1WvXsovGI8Vb1kizrvRZjFWwQUkCVIL9AVVBKtPi4Sls33Errw5DIRH3Ni4zFX1q97gGxYDGT_fbMT-kNhddd0rI6myqLPYdXJvya4U Jun 30 18:39:19.413440 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Id: None Jun 30 18:39:19.413440 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Name: None Jun 30 18:39:19.413440 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Identity-Status: Confirmed Jun 30 18:39:19.413440 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Is-Admin-Project: True Jun 30 18:39:19.413440 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Id: default Jun 30 18:39:19.413440 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Name: Default Jun 30 18:39:19.413440 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Id: 76384f04296b43b69e675de14cf1a55a Jun 30 18:39:19.413440 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Name: tempest-AttachVolumeTestJSON-1612416413 Jun 30 18:39:19.413440 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Role: reader,member Jun 30 18:39:19.413440 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Roles: reader,member Jun 30 18:39:19.415041 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/76384f04296b43b69e675de14cf1a55a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_76384f04296b43b69e675de14cf1a55a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/76384f04296b43b69e675de14cf1a55a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/76384f04296b43b69e675de14cf1a55a"}]}] Jun 30 18:39:19.415041 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant: tempest-AttachVolumeTestJSON-1612416413 Jun 30 18:39:19.415041 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Id: 76384f04296b43b69e675de14cf1a55a Jun 30 18:39:19.415041 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1612416413 Jun 30 18:39:19.415041 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User: tempest-AttachVolumeTestJSON-1612416413-project Jun 30 18:39:19.415041 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Id: default Jun 30 18:39:19.415041 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Name: Default Jun 30 18:39:19.415041 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Id: 6ac4fc6cab4f47ea910ffdbed0a8e5b8 Jun 30 18:39:19.415041 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Name: tempest-AttachVolumeTestJSON-1612416413-project Jun 30 18:39:19.415041 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: method: > Jun 30 18:39:19.415041 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: exception: Instance a70367a4-54b1-405e-9b10-5356217349d4 could not be found. Jun 30 18:39:19.415041 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: action_args: {'id': 'a70367a4-54b1-405e-9b10-5356217349d4'} Jun 30 18:39:19.415974 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:39:19.415974 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:39:19.415974 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:39:19.415974 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:39:19.415974 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:39:19.415974 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:39:19.415974 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:39:19.415974 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:39:19.415974 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:39:19.415974 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:39:19.415974 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a70367a4-54b1-405e-9b10-5356217349d4 could not be found. Jun 30 18:39:19.415974 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:39:19.415974 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:39:19.415974 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:39:19.415974 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:39:19.415974 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:39:19.415974 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:39:19.415974 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:39:19.415974 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:39:19.415974 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:39:19.417418 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:39:19.417418 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:39:19.417418 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:39:19.417418 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:39:19.417418 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:39:19.417418 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:39:19.417418 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:39:19.417418 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a70367a4-54b1-405e-9b10-5356217349d4 could not be found. Jun 30 18:39:19.417418 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:39:19.417418 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:39:19.417418 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:39:19.417418 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:39:19.417418 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:39:19.417418 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:39:19.417418 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:39:19.417418 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:39:19.417418 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a70367a4-54b1-405e-9b10-5356217349d4 could not be found. Jun 30 18:39:19.417418 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:39:19.419405 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-757d74c5-bbc3-45cd-9c71-1ad735620617 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Returning 404 to user: Instance a70367a4-54b1-405e-9b10-5356217349d4 could not be found. {{(pid=117941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:39:19.419405 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-757d74c5-bbc3-45cd-9c71-1ad735620617 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4" status: 404 len: 111 microversion: 2.1 time: 0.030458 Jun 30 18:39:19.419405 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 519/1030] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:39:19 2022] GET /compute/v2.1/servers/a70367a4-54b1-405e-9b10-5356217349d4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:39:20.547524 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-3a8cef0b-914d-4b48-9bb9-0a97446459a4 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:39:20.548081 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-3a8cef0b-914d-4b48-9bb9-0a97446459a4 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:39:20.554716 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3a8cef0b-914d-4b48-9bb9-0a97446459a4 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:20.555159 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3a8cef0b-914d-4b48-9bb9-0a97446459a4 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:20.555914 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3a8cef0b-914d-4b48-9bb9-0a97446459a4 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:20.556346 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3a8cef0b-914d-4b48-9bb9-0a97446459a4 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:20.572167 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.wsgi [None req-3a8cef0b-914d-4b48-9bb9-0a97446459a4 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] HTTP exception thrown: Instance 2e559236-fa0a-4378-b21f-e5f5e669751d could not be found. Jun 30 18:39:20.573728 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-3a8cef0b-914d-4b48-9bb9-0a97446459a4 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Request method failure captured: Jun 30 18:39:20.573728 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: request: DELETE /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d HTTP/1.1 Jun 30 18:39:20.573728 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept: application/json Jun 30 18:39:20.573728 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept-Encoding: identity Jun 30 18:39:20.573728 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Connection: close Jun 30 18:39:20.573728 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Length: 0 Jun 30 18:39:20.573728 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Type: application/json Jun 30 18:39:20.573728 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Host: 10.222.0.33 Jun 30 18:39:20.573728 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Openstack-System-Scope: None Jun 30 18:39:20.573728 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: User-Agent: python-urllib3/1.26.9 Jun 30 18:39:20.573728 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Auth-Token: gAAAAABiveuuH82i-YLb0OxxVVWp1NwpPb1owgHQi2P6swgIWmFgaFrviBufDQYdbB4_ZJTyaS1yL1Yy1WvXsovGI8Vb1kizrvRZjFWwQUkCVIL9AVVBKtPi4Sls33Errw5DIRH3Ni4zFX1q97gGxYDGT_fbMT-kNhddd0rI6myqLPYdXJvya4U Jun 30 18:39:20.573728 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Id: None Jun 30 18:39:20.573728 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Name: None Jun 30 18:39:20.573728 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Identity-Status: Confirmed Jun 30 18:39:20.573728 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Is-Admin-Project: True Jun 30 18:39:20.573728 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Id: default Jun 30 18:39:20.573728 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Name: Default Jun 30 18:39:20.573728 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Id: 76384f04296b43b69e675de14cf1a55a Jun 30 18:39:20.573728 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Name: tempest-AttachVolumeTestJSON-1612416413 Jun 30 18:39:20.573728 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Role: reader,member Jun 30 18:39:20.573728 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Roles: reader,member Jun 30 18:39:20.575592 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/76384f04296b43b69e675de14cf1a55a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_76384f04296b43b69e675de14cf1a55a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/76384f04296b43b69e675de14cf1a55a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/76384f04296b43b69e675de14cf1a55a"}]}] Jun 30 18:39:20.575592 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant: tempest-AttachVolumeTestJSON-1612416413 Jun 30 18:39:20.575592 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Id: 76384f04296b43b69e675de14cf1a55a Jun 30 18:39:20.575592 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1612416413 Jun 30 18:39:20.575592 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User: tempest-AttachVolumeTestJSON-1612416413-project Jun 30 18:39:20.575592 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Id: default Jun 30 18:39:20.575592 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Name: Default Jun 30 18:39:20.575592 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Id: 6ac4fc6cab4f47ea910ffdbed0a8e5b8 Jun 30 18:39:20.575592 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Name: tempest-AttachVolumeTestJSON-1612416413-project Jun 30 18:39:20.575592 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: method: > Jun 30 18:39:20.575592 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: exception: Instance 2e559236-fa0a-4378-b21f-e5f5e669751d could not be found. Jun 30 18:39:20.575592 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: action_args: {'id': '2e559236-fa0a-4378-b21f-e5f5e669751d'} Jun 30 18:39:20.576667 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:39:20.576667 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:39:20.576667 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:39:20.576667 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:39:20.576667 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:39:20.576667 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:39:20.576667 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:39:20.576667 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:39:20.576667 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:39:20.576667 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:39:20.576667 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e559236-fa0a-4378-b21f-e5f5e669751d could not be found. Jun 30 18:39:20.576667 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:39:20.576667 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:39:20.576667 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:39:20.576667 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:39:20.576667 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:39:20.576667 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:39:20.576667 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:39:20.576667 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:39:20.576667 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:39:20.578194 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:39:20.578194 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 18:39:20.578194 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 18:39:20.578194 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 18:39:20.578194 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 18:39:20.578194 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:39:20.578194 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:39:20.578194 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:39:20.578194 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:39:20.578194 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e559236-fa0a-4378-b21f-e5f5e669751d could not be found. Jun 30 18:39:20.578194 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:39:20.578194 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:39:20.578194 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:39:20.578194 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:39:20.578194 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:39:20.578194 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:39:20.578194 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:39:20.578194 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:39:20.578194 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e559236-fa0a-4378-b21f-e5f5e669751d could not be found. Jun 30 18:39:20.578194 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:39:20.579749 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-3a8cef0b-914d-4b48-9bb9-0a97446459a4 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Returning 404 to user: Instance 2e559236-fa0a-4378-b21f-e5f5e669751d could not be found. {{(pid=117940) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:39:20.579749 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-3a8cef0b-914d-4b48-9bb9-0a97446459a4 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 404 len: 111 microversion: 2.1 time: 0.032194 Jun 30 18:39:20.579749 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 512/1031] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 30 18:39:20 2022] DELETE /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:39:20.583672 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-7ab7ebb6-c114-4719-9fcf-49fb1ad68ec4 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:39:20.584282 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-7ab7ebb6-c114-4719-9fcf-49fb1ad68ec4 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] [instance: 2e559236-fa0a-4378-b21f-e5f5e669751d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:39:20.591526 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7ab7ebb6-c114-4719-9fcf-49fb1ad68ec4 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:20.592285 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7ab7ebb6-c114-4719-9fcf-49fb1ad68ec4 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:20.593527 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7ab7ebb6-c114-4719-9fcf-49fb1ad68ec4 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:20.594328 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7ab7ebb6-c114-4719-9fcf-49fb1ad68ec4 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:20.609518 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.wsgi [None req-7ab7ebb6-c114-4719-9fcf-49fb1ad68ec4 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] HTTP exception thrown: Instance 2e559236-fa0a-4378-b21f-e5f5e669751d could not be found. Jun 30 18:39:20.611054 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-7ab7ebb6-c114-4719-9fcf-49fb1ad68ec4 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Request method failure captured: Jun 30 18:39:20.611054 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: request: GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d HTTP/1.1 Jun 30 18:39:20.611054 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept: application/json Jun 30 18:39:20.611054 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept-Encoding: identity Jun 30 18:39:20.611054 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Connection: close Jun 30 18:39:20.611054 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Length: 0 Jun 30 18:39:20.611054 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Type: application/json Jun 30 18:39:20.611054 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Host: 10.222.0.33 Jun 30 18:39:20.611054 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Openstack-System-Scope: None Jun 30 18:39:20.611054 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: User-Agent: python-urllib3/1.26.9 Jun 30 18:39:20.611054 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Auth-Token: gAAAAABiveuuH82i-YLb0OxxVVWp1NwpPb1owgHQi2P6swgIWmFgaFrviBufDQYdbB4_ZJTyaS1yL1Yy1WvXsovGI8Vb1kizrvRZjFWwQUkCVIL9AVVBKtPi4Sls33Errw5DIRH3Ni4zFX1q97gGxYDGT_fbMT-kNhddd0rI6myqLPYdXJvya4U Jun 30 18:39:20.611054 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Id: None Jun 30 18:39:20.611054 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Name: None Jun 30 18:39:20.611054 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Identity-Status: Confirmed Jun 30 18:39:20.611054 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Is-Admin-Project: True Jun 30 18:39:20.611054 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Id: default Jun 30 18:39:20.611054 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Name: Default Jun 30 18:39:20.611054 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Id: 76384f04296b43b69e675de14cf1a55a Jun 30 18:39:20.611054 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Name: tempest-AttachVolumeTestJSON-1612416413 Jun 30 18:39:20.611054 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Role: reader,member Jun 30 18:39:20.611054 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Roles: reader,member Jun 30 18:39:20.612684 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/76384f04296b43b69e675de14cf1a55a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_76384f04296b43b69e675de14cf1a55a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/76384f04296b43b69e675de14cf1a55a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/76384f04296b43b69e675de14cf1a55a"}]}] Jun 30 18:39:20.612684 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant: tempest-AttachVolumeTestJSON-1612416413 Jun 30 18:39:20.612684 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Id: 76384f04296b43b69e675de14cf1a55a Jun 30 18:39:20.612684 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1612416413 Jun 30 18:39:20.612684 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User: tempest-AttachVolumeTestJSON-1612416413-project Jun 30 18:39:20.612684 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Id: default Jun 30 18:39:20.612684 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Name: Default Jun 30 18:39:20.612684 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Id: 6ac4fc6cab4f47ea910ffdbed0a8e5b8 Jun 30 18:39:20.612684 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Name: tempest-AttachVolumeTestJSON-1612416413-project Jun 30 18:39:20.612684 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: method: > Jun 30 18:39:20.612684 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: exception: Instance 2e559236-fa0a-4378-b21f-e5f5e669751d could not be found. Jun 30 18:39:20.612684 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: action_args: {'id': '2e559236-fa0a-4378-b21f-e5f5e669751d'} Jun 30 18:39:20.613603 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:39:20.613603 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:39:20.613603 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:39:20.613603 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:39:20.613603 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:39:20.613603 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:39:20.613603 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:39:20.613603 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:39:20.613603 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:39:20.613603 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:39:20.613603 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e559236-fa0a-4378-b21f-e5f5e669751d could not be found. Jun 30 18:39:20.613603 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:39:20.613603 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:39:20.613603 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:39:20.613603 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:39:20.613603 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:39:20.613603 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:39:20.613603 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:39:20.613603 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:39:20.613603 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:39:20.615143 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:39:20.615143 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:39:20.615143 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:39:20.615143 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:39:20.615143 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:39:20.615143 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:39:20.615143 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:39:20.615143 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e559236-fa0a-4378-b21f-e5f5e669751d could not be found. Jun 30 18:39:20.615143 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:39:20.615143 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:39:20.615143 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:39:20.615143 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:39:20.615143 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:39:20.615143 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:39:20.615143 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:39:20.615143 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:39:20.615143 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e559236-fa0a-4378-b21f-e5f5e669751d could not be found. Jun 30 18:39:20.615143 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:39:20.616627 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-7ab7ebb6-c114-4719-9fcf-49fb1ad68ec4 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] Returning 404 to user: Instance 2e559236-fa0a-4378-b21f-e5f5e669751d could not be found. {{(pid=117941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:39:20.616627 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-7ab7ebb6-c114-4719-9fcf-49fb1ad68ec4 tempest-AttachVolumeTestJSON-1612416413 tempest-AttachVolumeTestJSON-1612416413-project] 10.222.0.33 "GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d" status: 404 len: 111 microversion: 2.1 time: 0.032792 Jun 30 18:39:20.616627 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 520/1032] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:39:20 2022] GET /compute/v2.1/servers/2e559236-fa0a-4378-b21f-e5f5e669751d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:39:39.008451 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-37c0f536-b551-414b-b3a4-1f42b5d65d42 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:39:39.009552 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-37c0f536-b551-414b-b3a4-1f42b5d65d42 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:39:39.017839 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:39:39.019132 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:39:39.021957 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-37c0f536-b551-414b-b3a4-1f42b5d65d42 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:39.022429 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-37c0f536-b551-414b-b3a4-1f42b5d65d42 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:39.024376 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-37c0f536-b551-414b-b3a4-1f42b5d65d42 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:39.025200 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-37c0f536-b551-414b-b3a4-1f42b5d65d42 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:39.070361 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-37c0f536-b551-414b-b3a4-1f42b5d65d42 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.066362 Jun 30 18:39:39.070959 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 513/1033] 10.222.0.33 () {60 vars in 1342 bytes} [Thu Jun 30 18:39:39 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:39:39.132415 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-8df11981-6a6c-47d9-a991-1e898aa97e1e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:39:39.133063 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-8df11981-6a6c-47d9-a991-1e898aa97e1e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:39:39.135489 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:39:39.136202 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell1:SELECT=38,nova_cell1:INSERT=1 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:39:39.142284 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8df11981-6a6c-47d9-a991-1e898aa97e1e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:39.142734 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8df11981-6a6c-47d9-a991-1e898aa97e1e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:39.143500 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8df11981-6a6c-47d9-a991-1e898aa97e1e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:39.143933 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8df11981-6a6c-47d9-a991-1e898aa97e1e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:39.176226 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-8df11981-6a6c-47d9-a991-1e898aa97e1e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Going to try to terminate instance {{(pid=117941) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 18:39:39.262582 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-8df11981-6a6c-47d9-a991-1e898aa97e1e tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 204 len: 0 microversion: 2.20 time: 0.134041 Jun 30 18:39:39.263208 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 521/1034] 10.222.0.33 () {60 vars in 1279 bytes} [Thu Jun 30 18:39:39 2022] DELETE /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 30 18:39:39.271608 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-13f2ab57-a465-4d30-888f-76b9438c5c33 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:39:39.272229 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-13f2ab57-a465-4d30-888f-76b9438c5c33 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:39:39.278608 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-13f2ab57-a465-4d30-888f-76b9438c5c33 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:39.279059 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-13f2ab57-a465-4d30-888f-76b9438c5c33 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:39.279825 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-13f2ab57-a465-4d30-888f-76b9438c5c33 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:39.280263 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-13f2ab57-a465-4d30-888f-76b9438c5c33 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:39.416248 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-13f2ab57-a465-4d30-888f-76b9438c5c33 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:39:39.426106 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-13f2ab57-a465-4d30-888f-76b9438c5c33 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:39:39.426106 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-13f2ab57-a465-4d30-888f-76b9438c5c33 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:39:39.427009 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-13f2ab57-a465-4d30-888f-76b9438c5c33 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1724 microversion: 2.20 time: 0.159342 Jun 30 18:39:39.427723 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 514/1035] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:39:39 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:39:40.446677 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-eb5299ce-a276-4f40-aeda-51ff9ff421f2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:39:40.447404 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-eb5299ce-a276-4f40-aeda-51ff9ff421f2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:39:40.454161 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-eb5299ce-a276-4f40-aeda-51ff9ff421f2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:40.454608 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-eb5299ce-a276-4f40-aeda-51ff9ff421f2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:40.455363 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-eb5299ce-a276-4f40-aeda-51ff9ff421f2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:40.455798 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-eb5299ce-a276-4f40-aeda-51ff9ff421f2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:40.601653 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-eb5299ce-a276-4f40-aeda-51ff9ff421f2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:39:40.609844 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-eb5299ce-a276-4f40-aeda-51ff9ff421f2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:39:40.611343 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-eb5299ce-a276-4f40-aeda-51ff9ff421f2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:39:40.612536 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-eb5299ce-a276-4f40-aeda-51ff9ff421f2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1724 microversion: 2.20 time: 0.170775 Jun 30 18:39:40.613086 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 522/1036] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:39:40 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:39:41.632732 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-492e42af-d5c0-4dd0-b102-eb6b943d8fb2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:39:41.633384 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-492e42af-d5c0-4dd0-b102-eb6b943d8fb2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:39:41.640439 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-492e42af-d5c0-4dd0-b102-eb6b943d8fb2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:41.641175 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-492e42af-d5c0-4dd0-b102-eb6b943d8fb2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:41.642046 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-492e42af-d5c0-4dd0-b102-eb6b943d8fb2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:41.642554 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-492e42af-d5c0-4dd0-b102-eb6b943d8fb2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:41.715201 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-492e42af-d5c0-4dd0-b102-eb6b943d8fb2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:39:41.727878 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-492e42af-d5c0-4dd0-b102-eb6b943d8fb2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:39:41.729678 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-492e42af-d5c0-4dd0-b102-eb6b943d8fb2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13e9e1bf5084d08919845767c70c3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f643222ab6194191979d2e884f5ed75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:39:41.731317 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-492e42af-d5c0-4dd0-b102-eb6b943d8fb2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 200 len: 1656 microversion: 2.20 time: 0.103788 Jun 30 18:39:41.732442 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 515/1037] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:39:41 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 1656 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:39:42.094858 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-5a111ec4-29b5-4063-921e-e7ec4c678377 req-3df7c870-a397-4252-b74c-d9984e486e45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2c839c4-5e9d-433d-ac94-1d8f3f0875e3", "name": "network-vif-deleted", "tag": "c81ef70e-10e5-414c-8ee1-71b2bd8320c9"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:39:42.105729 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-5a111ec4-29b5-4063-921e-e7ec4c678377 req-3df7c870-a397-4252-b74c-d9984e486e45 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:42.106177 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-5a111ec4-29b5-4063-921e-e7ec4c678377 req-3df7c870-a397-4252-b74c-d9984e486e45 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:42.120411 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.compute.server_external_events [req-5a111ec4-29b5-4063-921e-e7ec4c678377 req-3df7c870-a397-4252-b74c-d9984e486e45 service nova] Creating event network-vif-deleted:c81ef70e-10e5-414c-8ee1-71b2bd8320c9 for instance a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 on hv-cinder-80378 Jun 30 18:39:42.125883 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-5a111ec4-29b5-4063-921e-e7ec4c678377 req-3df7c870-a397-4252-b74c-d9984e486e45 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.353010 Jun 30 18:39:42.126841 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 523/1038] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:39:42.751566 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-13c0a839-958d-4706-94ea-dbf31f888990 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:39:42.752345 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-13c0a839-958d-4706-94ea-dbf31f888990 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:39:42.764031 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-13c0a839-958d-4706-94ea-dbf31f888990 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:42.764478 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-13c0a839-958d-4706-94ea-dbf31f888990 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:42.765239 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-13c0a839-958d-4706-94ea-dbf31f888990 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:42.765863 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-13c0a839-958d-4706-94ea-dbf31f888990 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:42.782318 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.wsgi [None req-13c0a839-958d-4706-94ea-dbf31f888990 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] HTTP exception thrown: Instance a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 could not be found. Jun 30 18:39:42.784084 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-13c0a839-958d-4706-94ea-dbf31f888990 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Request method failure captured: Jun 30 18:39:42.784084 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: request: GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 HTTP/1.1 Jun 30 18:39:42.784084 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept: application/json Jun 30 18:39:42.784084 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept-Encoding: identity Jun 30 18:39:42.784084 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Connection: close Jun 30 18:39:42.784084 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Length: 0 Jun 30 18:39:42.784084 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Type: application/json Jun 30 18:39:42.784084 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Host: 10.222.0.33 Jun 30 18:39:42.784084 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Openstack-System-Scope: None Jun 30 18:39:42.784084 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: User-Agent: python-urllib3/1.26.9 Jun 30 18:39:42.784084 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Auth-Token: gAAAAABivetSuQOwT4vFm5flZxm1eDj6M2nBWqWHKgsP9UECOLhkByjFxHVfqDcxNK6adn6a-YDjDfHkfGsNXlIBYKd0OcH0-no2so9YWdT32bQRPtKlQyVnMoYhXOYtW_-G8k_q0VBToOERLvKQaEkefnpYN9VwvtR1bJY5F6jVS-tnLtYrNkI Jun 30 18:39:42.784084 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Id: None Jun 30 18:39:42.784084 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Name: None Jun 30 18:39:42.784084 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Identity-Status: Confirmed Jun 30 18:39:42.784084 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Is-Admin-Project: True Jun 30 18:39:42.784084 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 18:39:42.784084 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Id: default Jun 30 18:39:42.784084 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Name: Default Jun 30 18:39:42.784084 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Id: f643222ab6194191979d2e884f5ed75a Jun 30 18:39:42.784084 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-72931025 Jun 30 18:39:42.784084 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Role: reader,member Jun 30 18:39:42.784084 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Roles: reader,member Jun 30 18:39:42.785980 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f643222ab6194191979d2e884f5ed75a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f643222ab6194191979d2e884f5ed75a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f643222ab6194191979d2e884f5ed75a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f643222ab6194191979d2e884f5ed75a"}]}] Jun 30 18:39:42.785980 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant: tempest-AttachVolumeShelveTestJSON-72931025 Jun 30 18:39:42.785980 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Id: f643222ab6194191979d2e884f5ed75a Jun 30 18:39:42.785980 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-72931025 Jun 30 18:39:42.785980 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User: tempest-AttachVolumeShelveTestJSON-72931025-project Jun 30 18:39:42.785980 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Id: default Jun 30 18:39:42.785980 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Name: Default Jun 30 18:39:42.785980 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Id: f13e9e1bf5084d08919845767c70c3f7 Jun 30 18:39:42.785980 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Name: tempest-AttachVolumeShelveTestJSON-72931025-project Jun 30 18:39:42.785980 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: method: > Jun 30 18:39:42.785980 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: exception: Instance a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 could not be found. Jun 30 18:39:42.785980 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: action_args: {'id': 'a2c839c4-5e9d-433d-ac94-1d8f3f0875e3'} Jun 30 18:39:42.786954 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:39:42.786954 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:39:42.786954 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:39:42.786954 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:39:42.786954 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:39:42.786954 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:39:42.786954 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:39:42.786954 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:39:42.786954 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:39:42.786954 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:39:42.786954 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 could not be found. Jun 30 18:39:42.786954 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:39:42.786954 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:39:42.786954 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:39:42.786954 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:39:42.786954 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:39:42.786954 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:39:42.786954 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:39:42.786954 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:39:42.786954 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:39:42.790010 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:39:42.790010 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:39:42.790010 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:39:42.790010 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:39:42.790010 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:39:42.790010 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:39:42.790010 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:39:42.790010 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 could not be found. Jun 30 18:39:42.790010 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:39:42.790010 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:39:42.790010 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:39:42.790010 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:39:42.790010 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:39:42.790010 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:39:42.790010 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:39:42.790010 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:39:42.790010 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 could not be found. Jun 30 18:39:42.790010 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:39:42.793767 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-13c0a839-958d-4706-94ea-dbf31f888990 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Returning 404 to user: Instance a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 could not be found. {{(pid=117940) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:39:42.794077 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-13c0a839-958d-4706-94ea-dbf31f888990 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 404 len: 111 microversion: 2.20 time: 0.046419 Jun 30 18:39:42.798726 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 516/1039] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:39:42 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 30 18:39:42.807089 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-36cce07f-e267-404b-afd3-b9ffa3ffc87f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '.version_select at 0x7f1804d16f70>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:39:42.829988 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-36cce07f-e267-404b-afd3-b9ffa3ffc87f tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1875162518" status: 204 len: 0 microversion: 2.20 time: 0.029390 Jun 30 18:39:42.831308 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 524/1040] 10.222.0.33 () {60 vars in 1261 bytes} [Thu Jun 30 18:39:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1875162518 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 30 18:39:44.652868 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-a0d5a4aa-f269-446e-b843-6eb715b102bf tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:39:44.653513 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-a0d5a4aa-f269-446e-b843-6eb715b102bf tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:39:44.659922 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a0d5a4aa-f269-446e-b843-6eb715b102bf tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:44.660362 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a0d5a4aa-f269-446e-b843-6eb715b102bf tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:44.661111 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a0d5a4aa-f269-446e-b843-6eb715b102bf tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:44.661541 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a0d5a4aa-f269-446e-b843-6eb715b102bf tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:44.675273 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.wsgi [None req-a0d5a4aa-f269-446e-b843-6eb715b102bf tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] HTTP exception thrown: Instance a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 could not be found. Jun 30 18:39:44.676786 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-a0d5a4aa-f269-446e-b843-6eb715b102bf tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Request method failure captured: Jun 30 18:39:44.676786 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: request: DELETE /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 HTTP/1.1 Jun 30 18:39:44.676786 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept: application/json Jun 30 18:39:44.676786 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept-Encoding: identity Jun 30 18:39:44.676786 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Connection: close Jun 30 18:39:44.676786 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Length: 0 Jun 30 18:39:44.676786 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Type: application/json Jun 30 18:39:44.676786 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Host: 10.222.0.33 Jun 30 18:39:44.676786 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Openstack-System-Scope: None Jun 30 18:39:44.676786 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: User-Agent: python-urllib3/1.26.9 Jun 30 18:39:44.676786 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Auth-Token: gAAAAABivetSuQOwT4vFm5flZxm1eDj6M2nBWqWHKgsP9UECOLhkByjFxHVfqDcxNK6adn6a-YDjDfHkfGsNXlIBYKd0OcH0-no2so9YWdT32bQRPtKlQyVnMoYhXOYtW_-G8k_q0VBToOERLvKQaEkefnpYN9VwvtR1bJY5F6jVS-tnLtYrNkI Jun 30 18:39:44.676786 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Id: None Jun 30 18:39:44.676786 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Name: None Jun 30 18:39:44.676786 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Identity-Status: Confirmed Jun 30 18:39:44.676786 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Is-Admin-Project: True Jun 30 18:39:44.676786 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 18:39:44.676786 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Id: default Jun 30 18:39:44.676786 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Name: Default Jun 30 18:39:44.676786 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Id: f643222ab6194191979d2e884f5ed75a Jun 30 18:39:44.676786 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-72931025 Jun 30 18:39:44.676786 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Role: reader,member Jun 30 18:39:44.676786 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Roles: reader,member Jun 30 18:39:44.679181 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f643222ab6194191979d2e884f5ed75a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f643222ab6194191979d2e884f5ed75a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f643222ab6194191979d2e884f5ed75a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f643222ab6194191979d2e884f5ed75a"}]}] Jun 30 18:39:44.679181 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant: tempest-AttachVolumeShelveTestJSON-72931025 Jun 30 18:39:44.679181 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Id: f643222ab6194191979d2e884f5ed75a Jun 30 18:39:44.679181 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-72931025 Jun 30 18:39:44.679181 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User: tempest-AttachVolumeShelveTestJSON-72931025-project Jun 30 18:39:44.679181 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Id: default Jun 30 18:39:44.679181 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Name: Default Jun 30 18:39:44.679181 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Id: f13e9e1bf5084d08919845767c70c3f7 Jun 30 18:39:44.679181 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Name: tempest-AttachVolumeShelveTestJSON-72931025-project Jun 30 18:39:44.679181 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: method: > Jun 30 18:39:44.679181 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: exception: Instance a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 could not be found. Jun 30 18:39:44.679181 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: action_args: {'id': 'a2c839c4-5e9d-433d-ac94-1d8f3f0875e3'} Jun 30 18:39:44.680298 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:39:44.680298 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:39:44.680298 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:39:44.680298 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:39:44.680298 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:39:44.680298 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:39:44.680298 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:39:44.680298 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:39:44.680298 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:39:44.680298 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:39:44.680298 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 could not be found. Jun 30 18:39:44.680298 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:39:44.680298 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:39:44.680298 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:39:44.680298 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:39:44.680298 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:39:44.680298 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:39:44.680298 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:39:44.680298 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:39:44.680298 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:39:44.681878 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:39:44.681878 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 18:39:44.681878 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 18:39:44.681878 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 18:39:44.681878 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 18:39:44.681878 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:39:44.681878 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:39:44.681878 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:39:44.681878 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:39:44.681878 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 could not be found. Jun 30 18:39:44.681878 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:39:44.681878 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:39:44.681878 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:39:44.681878 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:39:44.681878 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:39:44.681878 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:39:44.681878 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:39:44.681878 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:39:44.681878 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 could not be found. Jun 30 18:39:44.681878 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:39:44.683412 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-a0d5a4aa-f269-446e-b843-6eb715b102bf tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Returning 404 to user: Instance a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 could not be found. {{(pid=117940) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:39:44.683412 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-a0d5a4aa-f269-446e-b843-6eb715b102bf tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 404 len: 111 microversion: 2.20 time: 0.029745 Jun 30 18:39:44.683412 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 517/1041] 10.222.0.33 () {60 vars in 1279 bytes} [Thu Jun 30 18:39:44 2022] DELETE /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 30 18:39:44.687133 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-d84eee85-7de7-4483-b8ce-d4cd2182acc2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:39:44.687852 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-d84eee85-7de7-4483-b8ce-d4cd2182acc2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: a2c839c4-5e9d-433d-ac94-1d8f3f0875e3] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:39:44.695094 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d84eee85-7de7-4483-b8ce-d4cd2182acc2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:44.695532 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d84eee85-7de7-4483-b8ce-d4cd2182acc2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:44.696272 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d84eee85-7de7-4483-b8ce-d4cd2182acc2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:44.696869 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d84eee85-7de7-4483-b8ce-d4cd2182acc2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:44.710841 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.wsgi [None req-d84eee85-7de7-4483-b8ce-d4cd2182acc2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] HTTP exception thrown: Instance a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 could not be found. Jun 30 18:39:44.712490 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-d84eee85-7de7-4483-b8ce-d4cd2182acc2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Request method failure captured: Jun 30 18:39:44.712490 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: request: GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 HTTP/1.1 Jun 30 18:39:44.712490 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept: application/json Jun 30 18:39:44.712490 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept-Encoding: identity Jun 30 18:39:44.712490 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Connection: close Jun 30 18:39:44.712490 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Length: 0 Jun 30 18:39:44.712490 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Type: application/json Jun 30 18:39:44.712490 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Host: 10.222.0.33 Jun 30 18:39:44.712490 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Openstack-System-Scope: None Jun 30 18:39:44.712490 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: User-Agent: python-urllib3/1.26.9 Jun 30 18:39:44.712490 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Auth-Token: gAAAAABivetSuQOwT4vFm5flZxm1eDj6M2nBWqWHKgsP9UECOLhkByjFxHVfqDcxNK6adn6a-YDjDfHkfGsNXlIBYKd0OcH0-no2so9YWdT32bQRPtKlQyVnMoYhXOYtW_-G8k_q0VBToOERLvKQaEkefnpYN9VwvtR1bJY5F6jVS-tnLtYrNkI Jun 30 18:39:44.712490 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Id: None Jun 30 18:39:44.712490 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Name: None Jun 30 18:39:44.712490 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Identity-Status: Confirmed Jun 30 18:39:44.712490 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Is-Admin-Project: True Jun 30 18:39:44.712490 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 18:39:44.712490 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Id: default Jun 30 18:39:44.712490 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Name: Default Jun 30 18:39:44.712490 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Id: f643222ab6194191979d2e884f5ed75a Jun 30 18:39:44.712490 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-72931025 Jun 30 18:39:44.712490 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Role: reader,member Jun 30 18:39:44.712490 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Roles: reader,member Jun 30 18:39:44.714210 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f643222ab6194191979d2e884f5ed75a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f643222ab6194191979d2e884f5ed75a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f643222ab6194191979d2e884f5ed75a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f643222ab6194191979d2e884f5ed75a"}]}] Jun 30 18:39:44.714210 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant: tempest-AttachVolumeShelveTestJSON-72931025 Jun 30 18:39:44.714210 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Id: f643222ab6194191979d2e884f5ed75a Jun 30 18:39:44.714210 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-72931025 Jun 30 18:39:44.714210 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User: tempest-AttachVolumeShelveTestJSON-72931025-project Jun 30 18:39:44.714210 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Id: default Jun 30 18:39:44.714210 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Name: Default Jun 30 18:39:44.714210 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Id: f13e9e1bf5084d08919845767c70c3f7 Jun 30 18:39:44.714210 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Name: tempest-AttachVolumeShelveTestJSON-72931025-project Jun 30 18:39:44.714210 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: method: > Jun 30 18:39:44.714210 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: exception: Instance a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 could not be found. Jun 30 18:39:44.714210 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: action_args: {'id': 'a2c839c4-5e9d-433d-ac94-1d8f3f0875e3'} Jun 30 18:39:44.715067 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:39:44.715067 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:39:44.715067 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:39:44.715067 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:39:44.715067 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:39:44.715067 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:39:44.715067 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:39:44.715067 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:39:44.715067 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:39:44.715067 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:39:44.715067 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 could not be found. Jun 30 18:39:44.715067 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:39:44.715067 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:39:44.715067 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:39:44.715067 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:39:44.715067 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:39:44.715067 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:39:44.715067 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:39:44.715067 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:39:44.715067 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:39:44.716658 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:39:44.716658 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:39:44.716658 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:39:44.716658 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:39:44.716658 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:39:44.716658 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:39:44.716658 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:39:44.716658 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 could not be found. Jun 30 18:39:44.716658 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:39:44.716658 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:39:44.716658 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:39:44.716658 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:39:44.716658 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:39:44.716658 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:39:44.716658 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:39:44.716658 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:39:44.716658 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 could not be found. Jun 30 18:39:44.716658 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:39:44.717933 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-d84eee85-7de7-4483-b8ce-d4cd2182acc2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Returning 404 to user: Instance a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 could not be found. {{(pid=117941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:39:44.717933 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-d84eee85-7de7-4483-b8ce-d4cd2182acc2 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3" status: 404 len: 111 microversion: 2.20 time: 0.030665 Jun 30 18:39:44.717933 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 525/1042] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:39:44 2022] GET /compute/v2.1/servers/a2c839c4-5e9d-433d-ac94-1d8f3f0875e3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 30 18:39:51.085774 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-9a4b6e07-7c8a-427b-9d4f-78cf973d30b5 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:39:51.086263 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-9a4b6e07-7c8a-427b-9d4f-78cf973d30b5 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:39:51.092669 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9a4b6e07-7c8a-427b-9d4f-78cf973d30b5 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:51.093111 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9a4b6e07-7c8a-427b-9d4f-78cf973d30b5 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:51.093888 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9a4b6e07-7c8a-427b-9d4f-78cf973d30b5 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:51.094317 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9a4b6e07-7c8a-427b-9d4f-78cf973d30b5 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:51.107871 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.wsgi [None req-9a4b6e07-7c8a-427b-9d4f-78cf973d30b5 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] HTTP exception thrown: Instance 85c4025a-1510-4b69-a54e-94c9864064b9 could not be found. Jun 30 18:39:51.109387 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-9a4b6e07-7c8a-427b-9d4f-78cf973d30b5 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Request method failure captured: Jun 30 18:39:51.109387 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: request: DELETE /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 HTTP/1.1 Jun 30 18:39:51.109387 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept: application/json Jun 30 18:39:51.109387 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept-Encoding: identity Jun 30 18:39:51.109387 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Connection: close Jun 30 18:39:51.109387 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Length: 0 Jun 30 18:39:51.109387 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Type: application/json Jun 30 18:39:51.109387 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Host: 10.222.0.33 Jun 30 18:39:51.109387 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Openstack-System-Scope: None Jun 30 18:39:51.109387 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: User-Agent: python-urllib3/1.26.9 Jun 30 18:39:51.109387 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Auth-Token: gAAAAABivetSuQOwT4vFm5flZxm1eDj6M2nBWqWHKgsP9UECOLhkByjFxHVfqDcxNK6adn6a-YDjDfHkfGsNXlIBYKd0OcH0-no2so9YWdT32bQRPtKlQyVnMoYhXOYtW_-G8k_q0VBToOERLvKQaEkefnpYN9VwvtR1bJY5F6jVS-tnLtYrNkI Jun 30 18:39:51.109387 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Id: None Jun 30 18:39:51.109387 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Name: None Jun 30 18:39:51.109387 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Identity-Status: Confirmed Jun 30 18:39:51.109387 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Is-Admin-Project: True Jun 30 18:39:51.109387 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 18:39:51.109387 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Id: default Jun 30 18:39:51.109387 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Name: Default Jun 30 18:39:51.109387 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Id: f643222ab6194191979d2e884f5ed75a Jun 30 18:39:51.109387 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-72931025 Jun 30 18:39:51.109387 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Role: reader,member Jun 30 18:39:51.109387 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Roles: reader,member Jun 30 18:39:51.111096 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f643222ab6194191979d2e884f5ed75a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f643222ab6194191979d2e884f5ed75a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f643222ab6194191979d2e884f5ed75a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f643222ab6194191979d2e884f5ed75a"}]}] Jun 30 18:39:51.111096 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant: tempest-AttachVolumeShelveTestJSON-72931025 Jun 30 18:39:51.111096 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Id: f643222ab6194191979d2e884f5ed75a Jun 30 18:39:51.111096 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-72931025 Jun 30 18:39:51.111096 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User: tempest-AttachVolumeShelveTestJSON-72931025-project Jun 30 18:39:51.111096 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Id: default Jun 30 18:39:51.111096 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Name: Default Jun 30 18:39:51.111096 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Id: f13e9e1bf5084d08919845767c70c3f7 Jun 30 18:39:51.111096 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Name: tempest-AttachVolumeShelveTestJSON-72931025-project Jun 30 18:39:51.111096 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: method: > Jun 30 18:39:51.111096 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: exception: Instance 85c4025a-1510-4b69-a54e-94c9864064b9 could not be found. Jun 30 18:39:51.111096 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: action_args: {'id': '85c4025a-1510-4b69-a54e-94c9864064b9'} Jun 30 18:39:51.111995 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:39:51.111995 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:39:51.111995 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:39:51.111995 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:39:51.111995 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:39:51.111995 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:39:51.111995 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:39:51.111995 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:39:51.111995 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:39:51.111995 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:39:51.111995 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85c4025a-1510-4b69-a54e-94c9864064b9 could not be found. Jun 30 18:39:51.111995 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:39:51.111995 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:39:51.111995 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:39:51.111995 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:39:51.111995 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:39:51.111995 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:39:51.111995 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:39:51.111995 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:39:51.111995 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:39:51.113489 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:39:51.113489 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 18:39:51.113489 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 18:39:51.113489 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 18:39:51.113489 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 18:39:51.113489 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:39:51.113489 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:39:51.113489 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:39:51.113489 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:39:51.113489 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85c4025a-1510-4b69-a54e-94c9864064b9 could not be found. Jun 30 18:39:51.113489 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:39:51.113489 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:39:51.113489 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:39:51.113489 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:39:51.113489 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:39:51.113489 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:39:51.113489 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:39:51.113489 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:39:51.113489 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85c4025a-1510-4b69-a54e-94c9864064b9 could not be found. Jun 30 18:39:51.113489 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:39:51.115681 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-9a4b6e07-7c8a-427b-9d4f-78cf973d30b5 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Returning 404 to user: Instance 85c4025a-1510-4b69-a54e-94c9864064b9 could not be found. {{(pid=117940) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:39:51.115681 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-9a4b6e07-7c8a-427b-9d4f-78cf973d30b5 tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "DELETE /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 404 len: 111 microversion: 2.20 time: 0.029460 Jun 30 18:39:51.115681 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 518/1043] 10.222.0.33 () {60 vars in 1279 bytes} [Thu Jun 30 18:39:51 2022] DELETE /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 30 18:39:51.120032 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-94e712d5-058a-456b-bae3-0b45925cbadd tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:39:51.120642 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-94e712d5-058a-456b-bae3-0b45925cbadd tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] [instance: 85c4025a-1510-4b69-a54e-94c9864064b9] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:39:51.127384 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-94e712d5-058a-456b-bae3-0b45925cbadd tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:51.127828 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-94e712d5-058a-456b-bae3-0b45925cbadd tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:51.128583 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-94e712d5-058a-456b-bae3-0b45925cbadd tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:39:51.129015 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-94e712d5-058a-456b-bae3-0b45925cbadd tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:39:51.142679 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.wsgi [None req-94e712d5-058a-456b-bae3-0b45925cbadd tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] HTTP exception thrown: Instance 85c4025a-1510-4b69-a54e-94c9864064b9 could not be found. Jun 30 18:39:51.144178 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-94e712d5-058a-456b-bae3-0b45925cbadd tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Request method failure captured: Jun 30 18:39:51.144178 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: request: GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 HTTP/1.1 Jun 30 18:39:51.144178 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept: application/json Jun 30 18:39:51.144178 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept-Encoding: identity Jun 30 18:39:51.144178 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Connection: close Jun 30 18:39:51.144178 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Length: 0 Jun 30 18:39:51.144178 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Type: application/json Jun 30 18:39:51.144178 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Host: 10.222.0.33 Jun 30 18:39:51.144178 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Openstack-System-Scope: None Jun 30 18:39:51.144178 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: User-Agent: python-urllib3/1.26.9 Jun 30 18:39:51.144178 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Auth-Token: gAAAAABivetSuQOwT4vFm5flZxm1eDj6M2nBWqWHKgsP9UECOLhkByjFxHVfqDcxNK6adn6a-YDjDfHkfGsNXlIBYKd0OcH0-no2so9YWdT32bQRPtKlQyVnMoYhXOYtW_-G8k_q0VBToOERLvKQaEkefnpYN9VwvtR1bJY5F6jVS-tnLtYrNkI Jun 30 18:39:51.144178 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Id: None Jun 30 18:39:51.144178 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Name: None Jun 30 18:39:51.144178 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Identity-Status: Confirmed Jun 30 18:39:51.144178 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Is-Admin-Project: True Jun 30 18:39:51.144178 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 18:39:51.144178 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Id: default Jun 30 18:39:51.144178 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Name: Default Jun 30 18:39:51.144178 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Id: f643222ab6194191979d2e884f5ed75a Jun 30 18:39:51.144178 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-72931025 Jun 30 18:39:51.144178 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Role: reader,member Jun 30 18:39:51.144178 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Roles: reader,member Jun 30 18:39:51.146129 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f643222ab6194191979d2e884f5ed75a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f643222ab6194191979d2e884f5ed75a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f643222ab6194191979d2e884f5ed75a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f643222ab6194191979d2e884f5ed75a"}]}] Jun 30 18:39:51.146129 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant: tempest-AttachVolumeShelveTestJSON-72931025 Jun 30 18:39:51.146129 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Id: f643222ab6194191979d2e884f5ed75a Jun 30 18:39:51.146129 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-72931025 Jun 30 18:39:51.146129 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User: tempest-AttachVolumeShelveTestJSON-72931025-project Jun 30 18:39:51.146129 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Id: default Jun 30 18:39:51.146129 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Name: Default Jun 30 18:39:51.146129 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Id: f13e9e1bf5084d08919845767c70c3f7 Jun 30 18:39:51.146129 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Name: tempest-AttachVolumeShelveTestJSON-72931025-project Jun 30 18:39:51.146129 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: method: > Jun 30 18:39:51.146129 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: exception: Instance 85c4025a-1510-4b69-a54e-94c9864064b9 could not be found. Jun 30 18:39:51.146129 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: action_args: {'id': '85c4025a-1510-4b69-a54e-94c9864064b9'} Jun 30 18:39:51.146999 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:39:51.146999 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:39:51.146999 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:39:51.146999 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:39:51.146999 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:39:51.146999 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:39:51.146999 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:39:51.146999 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:39:51.146999 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:39:51.146999 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:39:51.146999 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85c4025a-1510-4b69-a54e-94c9864064b9 could not be found. Jun 30 18:39:51.146999 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:39:51.146999 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:39:51.146999 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:39:51.146999 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:39:51.146999 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:39:51.146999 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:39:51.146999 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:39:51.146999 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:39:51.146999 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:39:51.148514 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:39:51.148514 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:39:51.148514 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:39:51.148514 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:39:51.148514 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:39:51.148514 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:39:51.148514 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:39:51.148514 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85c4025a-1510-4b69-a54e-94c9864064b9 could not be found. Jun 30 18:39:51.148514 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:39:51.148514 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:39:51.148514 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:39:51.148514 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:39:51.148514 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:39:51.148514 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:39:51.148514 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:39:51.148514 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:39:51.148514 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85c4025a-1510-4b69-a54e-94c9864064b9 could not be found. Jun 30 18:39:51.148514 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:39:51.149848 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-94e712d5-058a-456b-bae3-0b45925cbadd tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] Returning 404 to user: Instance 85c4025a-1510-4b69-a54e-94c9864064b9 could not be found. {{(pid=117941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:39:51.149848 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-94e712d5-058a-456b-bae3-0b45925cbadd tempest-AttachVolumeShelveTestJSON-72931025 tempest-AttachVolumeShelveTestJSON-72931025-project] 10.222.0.33 "GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9" status: 404 len: 111 microversion: 2.20 time: 0.029451 Jun 30 18:39:51.149848 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 526/1044] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 30 18:39:51 2022] GET /compute/v2.1/servers/85c4025a-1510-4b69-a54e-94c9864064b9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 30 18:39:59.552333 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-d90418bc-b69e-48d6-87a0-e21aa437e772 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-925331920", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-274103547", "security_groups": [{"name": "tempest-secgroup-smoke-1376425930"}], "block_device_mapping_v2": [{"uuid": "4643d5a0-15e2-426d-8060-7d41c3e69a5f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2fc6fe0c-6090-4d20-bc8a-e6954c35f796"}]}} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:39:59.734502 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.network.neutron [None req-d90418bc-b69e-48d6-87a0-e21aa437e772 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] validate_networks() for [('2fc6fe0c-6090-4d20-bc8a-e6954c35f796', None, None, None, None, None)] {{(pid=117940) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 18:39:59.931859 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-a9294be2-2e96-4331-999b-75af45de7c8d tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Action: 'create', calling method: .version_select at 0x7f1804d08430>, body: {"keypair": {"name": "tempest-keypair-543578275", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFb3ktyPb6FCJIqvPer5fIVxqoVkksZjwKjXObkHrw1wipROYSSAUbn3+tksrmPjEdNuPMTIMuzQr9cMGZV941dw7Tej6+dVv9wL2/n/6tQsydHMKw/K096P2BcD7whgMg=="}} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:39:59.947361 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.quota [None req-a9294be2-2e96-4331-999b-75af45de7c8d tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Getting quotas for project b8227be3d9a044ed888b2f54abd9463d. Resources: {'key_pairs'} {{(pid=117941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 18:39:59.956288 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.quota [None req-a9294be2-2e96-4331-999b-75af45de7c8d tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Getting quotas for user 9531d18446eb4488bbd1511cb3412925 and project b8227be3d9a044ed888b2f54abd9463d. Resources: {'key_pairs'} {{(pid=117941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 18:39:59.987246 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-a9294be2-2e96-4331-999b-75af45de7c8d tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.196575 Jun 30 18:39:59.988366 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 527/1045] 10.222.0.33 () {60 vars in 1158 bytes} [Thu Jun 30 18:39:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:40:00.312541 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-d90418bc-b69e-48d6-87a0-e21aa437e772 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Flavor limits 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 18:40:00.312977 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-d90418bc-b69e-48d6-87a0-e21aa437e772 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Image limits 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 18:40:00.313415 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-d90418bc-b69e-48d6-87a0-e21aa437e772 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Flavor pref 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 18:40:00.317450 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-d90418bc-b69e-48d6-87a0-e21aa437e772 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Image pref 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 18:40:00.317450 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-d90418bc-b69e-48d6-87a0-e21aa437e772 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 18:40:00.339694 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d90418bc-b69e-48d6-87a0-e21aa437e772 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:00.340074 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d90418bc-b69e-48d6-87a0-e21aa437e772 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:00.341147 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d90418bc-b69e-48d6-87a0-e21aa437e772 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:00.341281 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d90418bc-b69e-48d6-87a0-e21aa437e772 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:00.361518 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.quota [None req-d90418bc-b69e-48d6-87a0-e21aa437e772 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Getting quotas for project 64655c9e82bb4515a976f41ac93b242f. Resources: {'ram', 'instances', 'cores'} {{(pid=117940) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 18:40:00.366740 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.quota [None req-d90418bc-b69e-48d6-87a0-e21aa437e772 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Getting quotas for user 31c0594d0be84154a601d625bca699cd and project 64655c9e82bb4515a976f41ac93b242f. Resources: {'ram', 'instances', 'cores'} {{(pid=117940) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 18:40:00.428881 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-d90418bc-b69e-48d6-87a0-e21aa437e772 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Going to run 1 instances... {{(pid=117940) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 18:40:00.431122 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-d90418bc-b69e-48d6-87a0-e21aa437e772 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: ddef212b-cb7c-4978-ab68-1e9db1ea5246] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4643d5a0-15e2-426d-8060-7d41c3e69a5f',volume_size=None,volume_type=None)] {{(pid=117940) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 18:40:00.622436 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-d90418bc-b69e-48d6-87a0-e21aa437e772 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.076172 Jun 30 18:40:00.623571 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 519/1046] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 30 18:39:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 1078 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 30 18:40:00.633337 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-5832a039-96d2-44e2-9422-b1504372aa20 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:00.634021 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-5832a039-96d2-44e2-9422-b1504372aa20 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: ddef212b-cb7c-4978-ab68-1e9db1ea5246] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:00.719961 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-5832a039-96d2-44e2-9422-b1504372aa20 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:40:00.731156 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-5832a039-96d2-44e2-9422-b1504372aa20 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/ddef212b-cb7c-4978-ab68-1e9db1ea5246" status: 200 len: 1093 microversion: 2.1 time: 0.101570 Jun 30 18:40:00.732901 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 528/1047] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:00 2022] GET /compute/v2.1/servers/ddef212b-cb7c-4978-ab68-1e9db1ea5246 => generated 1093 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:40:01.750583 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-d4ece8e6-9a79-48ca-bd6a-d71a190b426d tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:01.751938 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-d4ece8e6-9a79-48ca-bd6a-d71a190b426d tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: ddef212b-cb7c-4978-ab68-1e9db1ea5246] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:01.768124 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d4ece8e6-9a79-48ca-bd6a-d71a190b426d tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:01.770160 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d4ece8e6-9a79-48ca-bd6a-d71a190b426d tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:01.771169 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d4ece8e6-9a79-48ca-bd6a-d71a190b426d tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:01.772576 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d4ece8e6-9a79-48ca-bd6a-d71a190b426d tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:01.882472 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-3cc3095c-13c5-4bcd-bf40-cdf0cf65bce6 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-821838012", "imageRef": "636d6d52-5033-47e1-bf75-0b4fc50c0bb0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c75ba402-1254-4901-ad58-40e30172cc26"}], "security_groups": [{"name": "tempest-securitygroup--2128805186"}], "key_name": "tempest-keypair-543578275", "user_data": "}} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:40:01.888024 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-d4ece8e6-9a79-48ca-bd6a-d71a190b426d tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:40:01.899736 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-d4ece8e6-9a79-48ca-bd6a-d71a190b426d tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/ddef212b-cb7c-4978-ab68-1e9db1ea5246" status: 200 len: 1191 microversion: 2.1 time: 0.154456 Jun 30 18:40:01.900676 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 520/1048] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:01 2022] GET /compute/v2.1/servers/ddef212b-cb7c-4978-ab68-1e9db1ea5246 => generated 1191 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:40:01.905287 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:40:02.043252 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.network.neutron [None req-3cc3095c-13c5-4bcd-bf40-cdf0cf65bce6 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] validate_networks() for [('c75ba402-1254-4901-ad58-40e30172cc26', None, None, None, None, None)] {{(pid=117941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 18:40:02.517166 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.virt.hardware [None req-3cc3095c-13c5-4bcd-bf40-cdf0cf65bce6 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Flavor limits 0:0:0 {{(pid=117941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 18:40:02.517743 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.virt.hardware [None req-3cc3095c-13c5-4bcd-bf40-cdf0cf65bce6 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Image limits 0:0:0 {{(pid=117941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 18:40:02.518577 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.virt.hardware [None req-3cc3095c-13c5-4bcd-bf40-cdf0cf65bce6 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Flavor pref 0:0:0 {{(pid=117941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 18:40:02.518973 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.virt.hardware [None req-3cc3095c-13c5-4bcd-bf40-cdf0cf65bce6 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Image pref 0:0:0 {{(pid=117941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 18:40:02.519452 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.virt.hardware [None req-3cc3095c-13c5-4bcd-bf40-cdf0cf65bce6 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 18:40:02.531429 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3cc3095c-13c5-4bcd-bf40-cdf0cf65bce6 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:02.531752 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3cc3095c-13c5-4bcd-bf40-cdf0cf65bce6 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:02.532717 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3cc3095c-13c5-4bcd-bf40-cdf0cf65bce6 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:02.533206 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3cc3095c-13c5-4bcd-bf40-cdf0cf65bce6 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:02.557631 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.quota [None req-3cc3095c-13c5-4bcd-bf40-cdf0cf65bce6 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Getting quotas for project b8227be3d9a044ed888b2f54abd9463d. Resources: {'ram', 'instances', 'cores'} {{(pid=117941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 18:40:02.563239 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.quota [None req-3cc3095c-13c5-4bcd-bf40-cdf0cf65bce6 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Getting quotas for user 9531d18446eb4488bbd1511cb3412925 and project b8227be3d9a044ed888b2f54abd9463d. Resources: {'ram', 'instances', 'cores'} {{(pid=117941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 18:40:02.578951 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-3cc3095c-13c5-4bcd-bf40-cdf0cf65bce6 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Going to run 1 instances... {{(pid=117941) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 18:40:02.582047 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-3cc3095c-13c5-4bcd-bf40-cdf0cf65bce6 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: f83962b1-e24e-41ad-969a-b5d8bc609f2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='636d6d52-5033-47e1-bf75-0b4fc50c0bb0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 18:40:02.634616 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3cc3095c-13c5-4bcd-bf40-cdf0cf65bce6 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [03c47758-59ec-4656-b4f3-2b39d4cb69b9] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 30 18:40:02.918328 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-cf86b023-5be3-420a-b73c-a5f96f855efc tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:02.919104 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-cf86b023-5be3-420a-b73c-a5f96f855efc tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: ddef212b-cb7c-4978-ab68-1e9db1ea5246] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:02.933070 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cf86b023-5be3-420a-b73c-a5f96f855efc tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:02.934476 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cf86b023-5be3-420a-b73c-a5f96f855efc tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:02.937131 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cf86b023-5be3-420a-b73c-a5f96f855efc tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:02.937994 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cf86b023-5be3-420a-b73c-a5f96f855efc tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:03.323004 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-cf86b023-5be3-420a-b73c-a5f96f855efc tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:40:03.336448 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-cf86b023-5be3-420a-b73c-a5f96f855efc tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/ddef212b-cb7c-4978-ab68-1e9db1ea5246" status: 200 len: 1277 microversion: 2.1 time: 0.423990 Jun 30 18:40:03.346172 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 521/1049] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:02 2022] GET /compute/v2.1/servers/ddef212b-cb7c-4978-ab68-1e9db1ea5246 => generated 1277 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:40:03.648822 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO oslo.messaging._drivers.impl_rabbit [None req-3cc3095c-13c5-4bcd-bf40-cdf0cf65bce6 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [03c47758-59ec-4656-b4f3-2b39d4cb69b9] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 44728. Jun 30 18:40:03.667482 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-3cc3095c-13c5-4bcd-bf40-cdf0cf65bce6 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.791052 Jun 30 18:40:03.673661 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 529/1050] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 30 18:40:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 1796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 30 18:40:03.679927 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-bfa3d204-0f38-4f1a-8d70-de6d5eddb443 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:03.680664 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-bfa3d204-0f38-4f1a-8d70-de6d5eddb443 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: f83962b1-e24e-41ad-969a-b5d8bc609f2c] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:03.743421 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-bfa3d204-0f38-4f1a-8d70-de6d5eddb443 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:40:03.750132 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-bfa3d204-0f38-4f1a-8d70-de6d5eddb443 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c" status: 200 len: 1240 microversion: 2.1 time: 0.074098 Jun 30 18:40:03.752022 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 522/1051] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:03 2022] GET /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c => generated 1240 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:40:04.173652 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-52566090-8068-4d6b-8f2d-7a6e583416a6 req-7b786404-5d7b-4acb-b5d1-503929fa8399 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddef212b-cb7c-4978-ab68-1e9db1ea5246", "tag": "9c6eff65-98fe-438e-96c1-652f799ad853"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:40:04.186980 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-52566090-8068-4d6b-8f2d-7a6e583416a6 req-7b786404-5d7b-4acb-b5d1-503929fa8399 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:04.188127 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-52566090-8068-4d6b-8f2d-7a6e583416a6 req-7b786404-5d7b-4acb-b5d1-503929fa8399 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:04.216576 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.compute.server_external_events [req-52566090-8068-4d6b-8f2d-7a6e583416a6 req-7b786404-5d7b-4acb-b5d1-503929fa8399 service nova] Creating event network-changed:9c6eff65-98fe-438e-96c1-652f799ad853 for instance ddef212b-cb7c-4978-ab68-1e9db1ea5246 on hv-cinder-80378 Jun 30 18:40:04.223210 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-52566090-8068-4d6b-8f2d-7a6e583416a6 req-7b786404-5d7b-4acb-b5d1-503929fa8399 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059104 Jun 30 18:40:04.224255 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 530/1052] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:40:04.353877 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-9229e72a-dbfa-40dd-ab69-bdea26768470 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:04.354512 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-9229e72a-dbfa-40dd-ab69-bdea26768470 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: ddef212b-cb7c-4978-ab68-1e9db1ea5246] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:04.375920 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9229e72a-dbfa-40dd-ab69-bdea26768470 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:04.376574 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9229e72a-dbfa-40dd-ab69-bdea26768470 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:04.377388 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9229e72a-dbfa-40dd-ab69-bdea26768470 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:04.379204 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9229e72a-dbfa-40dd-ab69-bdea26768470 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:04.568444 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-9229e72a-dbfa-40dd-ab69-bdea26768470 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:40:04.579201 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-9229e72a-dbfa-40dd-ab69-bdea26768470 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/ddef212b-cb7c-4978-ab68-1e9db1ea5246" status: 200 len: 1265 microversion: 2.1 time: 0.229973 Jun 30 18:40:04.580193 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 523/1053] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:04 2022] GET /compute/v2.1/servers/ddef212b-cb7c-4978-ab68-1e9db1ea5246 => generated 1265 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:40:04.768727 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-49083915-9c79-4aea-a28c-18baea84919c tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:04.769413 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-49083915-9c79-4aea-a28c-18baea84919c tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: f83962b1-e24e-41ad-969a-b5d8bc609f2c] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:04.775578 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-49083915-9c79-4aea-a28c-18baea84919c tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:04.776017 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-49083915-9c79-4aea-a28c-18baea84919c tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:04.776776 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-49083915-9c79-4aea-a28c-18baea84919c tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:04.777211 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-49083915-9c79-4aea-a28c-18baea84919c tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:04.847529 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-49083915-9c79-4aea-a28c-18baea84919c tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:40:04.855887 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-49083915-9c79-4aea-a28c-18baea84919c tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c" status: 200 len: 1292 microversion: 2.1 time: 0.091348 Jun 30 18:40:04.856782 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 531/1054] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:04 2022] GET /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c => generated 1292 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:40:05.596982 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-f32ea4d7-0f80-4346-b6d3-e90c9a25821f tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:05.597740 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-f32ea4d7-0f80-4346-b6d3-e90c9a25821f tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: ddef212b-cb7c-4978-ab68-1e9db1ea5246] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:05.605132 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f32ea4d7-0f80-4346-b6d3-e90c9a25821f tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:05.605716 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f32ea4d7-0f80-4346-b6d3-e90c9a25821f tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:05.606512 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f32ea4d7-0f80-4346-b6d3-e90c9a25821f tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:05.606957 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f32ea4d7-0f80-4346-b6d3-e90c9a25821f tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:05.744442 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-f32ea4d7-0f80-4346-b6d3-e90c9a25821f tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:40:05.751857 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-f32ea4d7-0f80-4346-b6d3-e90c9a25821f tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/ddef212b-cb7c-4978-ab68-1e9db1ea5246" status: 200 len: 1265 microversion: 2.1 time: 0.159328 Jun 30 18:40:05.752966 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 524/1055] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:05 2022] GET /compute/v2.1/servers/ddef212b-cb7c-4978-ab68-1e9db1ea5246 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:40:05.874966 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-954c3cd6-cf11-40b7-b313-864f7e8bb976 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:05.876436 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-954c3cd6-cf11-40b7-b313-864f7e8bb976 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: f83962b1-e24e-41ad-969a-b5d8bc609f2c] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:05.885887 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-954c3cd6-cf11-40b7-b313-864f7e8bb976 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:05.886335 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-954c3cd6-cf11-40b7-b313-864f7e8bb976 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:05.887113 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-954c3cd6-cf11-40b7-b313-864f7e8bb976 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:05.893103 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-954c3cd6-cf11-40b7-b313-864f7e8bb976 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:05.992833 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-954c3cd6-cf11-40b7-b313-864f7e8bb976 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:40:06.000402 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-954c3cd6-cf11-40b7-b313-864f7e8bb976 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c" status: 200 len: 1310 microversion: 2.1 time: 0.129483 Jun 30 18:40:06.001003 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 532/1056] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:05 2022] GET /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c => generated 1310 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:40:06.769015 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-43096218-26b5-473c-be3b-60ed509b8380 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:06.769652 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-43096218-26b5-473c-be3b-60ed509b8380 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: ddef212b-cb7c-4978-ab68-1e9db1ea5246] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:06.776086 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-43096218-26b5-473c-be3b-60ed509b8380 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:06.776535 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-43096218-26b5-473c-be3b-60ed509b8380 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:06.777296 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-43096218-26b5-473c-be3b-60ed509b8380 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:06.777765 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-43096218-26b5-473c-be3b-60ed509b8380 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:06.916782 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-43096218-26b5-473c-be3b-60ed509b8380 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:40:06.925122 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-43096218-26b5-473c-be3b-60ed509b8380 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/ddef212b-cb7c-4978-ab68-1e9db1ea5246" status: 200 len: 1265 microversion: 2.1 time: 0.160401 Jun 30 18:40:06.925733 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 525/1057] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:06 2022] GET /compute/v2.1/servers/ddef212b-cb7c-4978-ab68-1e9db1ea5246 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:40:07.019317 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-218bc7fa-ac2c-4253-887d-c926ef85e371 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:07.019886 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-218bc7fa-ac2c-4253-887d-c926ef85e371 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: f83962b1-e24e-41ad-969a-b5d8bc609f2c] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:07.026055 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-218bc7fa-ac2c-4253-887d-c926ef85e371 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:07.026688 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-218bc7fa-ac2c-4253-887d-c926ef85e371 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:07.027223 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-218bc7fa-ac2c-4253-887d-c926ef85e371 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:07.027721 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-218bc7fa-ac2c-4253-887d-c926ef85e371 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:07.169171 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [req-12d0d042-aa5b-4ab1-9ded-fe0df36f041b req-e9dba4c0-fc7a-4ef9-a995-43304bc0a04d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f83962b1-e24e-41ad-969a-b5d8bc609f2c", "tag": "9679e7ce-ab18-4116-94b9-2852dee5cfe7"}]} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:40:07.178917 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-12d0d042-aa5b-4ab1-9ded-fe0df36f041b req-e9dba4c0-fc7a-4ef9-a995-43304bc0a04d service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:07.179608 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-218bc7fa-ac2c-4253-887d-c926ef85e371 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:40:07.180022 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-12d0d042-aa5b-4ab1-9ded-fe0df36f041b req-e9dba4c0-fc7a-4ef9-a995-43304bc0a04d service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:07.195787 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-218bc7fa-ac2c-4253-887d-c926ef85e371 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c" status: 200 len: 1366 microversion: 2.1 time: 0.181873 Jun 30 18:40:07.198690 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 533/1058] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:07 2022] GET /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:40:07.201127 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.compute.server_external_events [req-12d0d042-aa5b-4ab1-9ded-fe0df36f041b req-e9dba4c0-fc7a-4ef9-a995-43304bc0a04d service nova] Creating event network-changed:9679e7ce-ab18-4116-94b9-2852dee5cfe7 for instance f83962b1-e24e-41ad-969a-b5d8bc609f2c on hv-cinder-80378 Jun 30 18:40:07.206709 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [req-12d0d042-aa5b-4ab1-9ded-fe0df36f041b req-e9dba4c0-fc7a-4ef9-a995-43304bc0a04d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041226 Jun 30 18:40:07.207299 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 526/1059] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:40:07.943408 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-65bdf956-29ef-4ca3-ae33-34e2eeda1779 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:07.943916 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-65bdf956-29ef-4ca3-ae33-34e2eeda1779 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: ddef212b-cb7c-4978-ab68-1e9db1ea5246] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:07.950311 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-65bdf956-29ef-4ca3-ae33-34e2eeda1779 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:07.950749 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-65bdf956-29ef-4ca3-ae33-34e2eeda1779 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:07.951503 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-65bdf956-29ef-4ca3-ae33-34e2eeda1779 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:07.951922 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-65bdf956-29ef-4ca3-ae33-34e2eeda1779 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:08.085878 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-65bdf956-29ef-4ca3-ae33-34e2eeda1779 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:40:08.093148 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-65bdf956-29ef-4ca3-ae33-34e2eeda1779 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/ddef212b-cb7c-4978-ab68-1e9db1ea5246" status: 200 len: 1265 microversion: 2.1 time: 0.155063 Jun 30 18:40:08.093722 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 534/1060] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:07 2022] GET /compute/v2.1/servers/ddef212b-cb7c-4978-ab68-1e9db1ea5246 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:40:08.215952 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-5cd2390b-4c06-41f8-8930-d85465c97830 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:08.216674 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-5cd2390b-4c06-41f8-8930-d85465c97830 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: f83962b1-e24e-41ad-969a-b5d8bc609f2c] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:08.223509 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5cd2390b-4c06-41f8-8930-d85465c97830 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:08.223952 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5cd2390b-4c06-41f8-8930-d85465c97830 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:08.224703 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5cd2390b-4c06-41f8-8930-d85465c97830 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:08.225138 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5cd2390b-4c06-41f8-8930-d85465c97830 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:08.358354 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-5cd2390b-4c06-41f8-8930-d85465c97830 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:40:08.365932 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-5cd2390b-4c06-41f8-8930-d85465c97830 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c" status: 200 len: 1366 microversion: 2.1 time: 0.154642 Jun 30 18:40:08.366501 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 527/1061] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:08 2022] GET /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:40:09.110385 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-9cca2f57-7a69-4e77-9e3a-d381c324c74b tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:09.111667 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-9cca2f57-7a69-4e77-9e3a-d381c324c74b tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: ddef212b-cb7c-4978-ab68-1e9db1ea5246] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:09.118112 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9cca2f57-7a69-4e77-9e3a-d381c324c74b tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:09.118778 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9cca2f57-7a69-4e77-9e3a-d381c324c74b tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:09.119782 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9cca2f57-7a69-4e77-9e3a-d381c324c74b tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:09.120249 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9cca2f57-7a69-4e77-9e3a-d381c324c74b tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:09.253083 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-9cca2f57-7a69-4e77-9e3a-d381c324c74b tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:40:09.260785 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-9cca2f57-7a69-4e77-9e3a-d381c324c74b tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/ddef212b-cb7c-4978-ab68-1e9db1ea5246" status: 200 len: 1265 microversion: 2.1 time: 0.154274 Jun 30 18:40:09.261350 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 535/1062] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:09 2022] GET /compute/v2.1/servers/ddef212b-cb7c-4978-ab68-1e9db1ea5246 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:40:09.382879 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-5c02f264-7ab1-4230-ba67-19f4d61a3252 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:09.383490 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-5c02f264-7ab1-4230-ba67-19f4d61a3252 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: f83962b1-e24e-41ad-969a-b5d8bc609f2c] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:09.385871 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:40:09.391148 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5c02f264-7ab1-4230-ba67-19f4d61a3252 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:09.391597 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5c02f264-7ab1-4230-ba67-19f4d61a3252 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:09.392483 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5c02f264-7ab1-4230-ba67-19f4d61a3252 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:09.392799 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5c02f264-7ab1-4230-ba67-19f4d61a3252 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:09.397494 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell1:SELECT=65 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:40:09.521347 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-5c02f264-7ab1-4230-ba67-19f4d61a3252 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:40:09.528682 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-5c02f264-7ab1-4230-ba67-19f4d61a3252 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c" status: 200 len: 1366 microversion: 2.1 time: 0.149690 Jun 30 18:40:09.529247 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 528/1063] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:09 2022] GET /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:40:10.277978 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-d954b77c-a4c0-49a8-9ff7-2e91905cb08d tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:10.278613 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-d954b77c-a4c0-49a8-9ff7-2e91905cb08d tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: ddef212b-cb7c-4978-ab68-1e9db1ea5246] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:10.281063 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:40:10.287780 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d954b77c-a4c0-49a8-9ff7-2e91905cb08d tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:10.288231 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d954b77c-a4c0-49a8-9ff7-2e91905cb08d tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:10.289033 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d954b77c-a4c0-49a8-9ff7-2e91905cb08d tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:10.289473 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d954b77c-a4c0-49a8-9ff7-2e91905cb08d tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:10.428937 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-d954b77c-a4c0-49a8-9ff7-2e91905cb08d tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:40:10.436280 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-d954b77c-a4c0-49a8-9ff7-2e91905cb08d tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/ddef212b-cb7c-4978-ab68-1e9db1ea5246" status: 200 len: 1265 microversion: 2.1 time: 0.162268 Jun 30 18:40:10.436841 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 536/1064] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:10 2022] GET /compute/v2.1/servers/ddef212b-cb7c-4978-ab68-1e9db1ea5246 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:40:10.545657 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-6f02bb19-c501-4fa2-b3cd-83b3a4a18a0c tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:10.546296 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-6f02bb19-c501-4fa2-b3cd-83b3a4a18a0c tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: f83962b1-e24e-41ad-969a-b5d8bc609f2c] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:10.548764 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell0:SELECT=2 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:40:10.555855 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6f02bb19-c501-4fa2-b3cd-83b3a4a18a0c tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:10.556388 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6f02bb19-c501-4fa2-b3cd-83b3a4a18a0c tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:10.557278 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6f02bb19-c501-4fa2-b3cd-83b3a4a18a0c tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:10.557780 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6f02bb19-c501-4fa2-b3cd-83b3a4a18a0c tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:10.691044 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-6f02bb19-c501-4fa2-b3cd-83b3a4a18a0c tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:40:10.698678 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-6f02bb19-c501-4fa2-b3cd-83b3a4a18a0c tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c" status: 200 len: 1366 microversion: 2.1 time: 0.156833 Jun 30 18:40:10.699240 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 529/1065] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:10 2022] GET /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:40:11.453172 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-cb04b738-eeb5-4659-ac54-2b07c21e7aa0 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:11.453846 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-cb04b738-eeb5-4659-ac54-2b07c21e7aa0 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: ddef212b-cb7c-4978-ab68-1e9db1ea5246] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:11.460850 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-cb04b738-eeb5-4659-ac54-2b07c21e7aa0 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:11.461290 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-cb04b738-eeb5-4659-ac54-2b07c21e7aa0 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:11.462068 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-cb04b738-eeb5-4659-ac54-2b07c21e7aa0 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:11.462490 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-cb04b738-eeb5-4659-ac54-2b07c21e7aa0 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:11.599930 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-cb04b738-eeb5-4659-ac54-2b07c21e7aa0 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:40:11.607356 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-cb04b738-eeb5-4659-ac54-2b07c21e7aa0 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/ddef212b-cb7c-4978-ab68-1e9db1ea5246" status: 200 len: 1265 microversion: 2.1 time: 0.158103 Jun 30 18:40:11.607905 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 537/1066] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:11 2022] GET /compute/v2.1/servers/ddef212b-cb7c-4978-ab68-1e9db1ea5246 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:40:11.714902 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-373ac237-1b34-4aa1-a223-72b13d390a66 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:11.715436 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-373ac237-1b34-4aa1-a223-72b13d390a66 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: f83962b1-e24e-41ad-969a-b5d8bc609f2c] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:11.722556 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-373ac237-1b34-4aa1-a223-72b13d390a66 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:11.723020 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-373ac237-1b34-4aa1-a223-72b13d390a66 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:11.723772 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-373ac237-1b34-4aa1-a223-72b13d390a66 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:11.724202 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-373ac237-1b34-4aa1-a223-72b13d390a66 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:11.851057 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-373ac237-1b34-4aa1-a223-72b13d390a66 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:40:11.858312 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-373ac237-1b34-4aa1-a223-72b13d390a66 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c" status: 200 len: 1366 microversion: 2.1 time: 0.147293 Jun 30 18:40:11.858874 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 530/1067] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:11 2022] GET /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:40:12.624041 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-66c017ed-6ea0-4404-86c9-a9301b2439b6 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:12.624645 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-66c017ed-6ea0-4404-86c9-a9301b2439b6 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: ddef212b-cb7c-4978-ab68-1e9db1ea5246] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:12.627818 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell0:SELECT=2 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:40:12.628476 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell0:SELECT=12 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:40:12.634376 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-66c017ed-6ea0-4404-86c9-a9301b2439b6 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:12.634820 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-66c017ed-6ea0-4404-86c9-a9301b2439b6 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:12.635573 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-66c017ed-6ea0-4404-86c9-a9301b2439b6 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:12.636002 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-66c017ed-6ea0-4404-86c9-a9301b2439b6 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:12.772024 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-66c017ed-6ea0-4404-86c9-a9301b2439b6 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:40:12.779579 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-66c017ed-6ea0-4404-86c9-a9301b2439b6 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/ddef212b-cb7c-4978-ab68-1e9db1ea5246" status: 200 len: 1265 microversion: 2.1 time: 0.159458 Jun 30 18:40:12.780195 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 538/1068] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:12 2022] GET /compute/v2.1/servers/ddef212b-cb7c-4978-ab68-1e9db1ea5246 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:40:12.877345 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-7ddc4fd6-89c2-4a39-b1fc-924c97f19f3c tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:12.877891 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-7ddc4fd6-89c2-4a39-b1fc-924c97f19f3c tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: f83962b1-e24e-41ad-969a-b5d8bc609f2c] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:12.884253 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7ddc4fd6-89c2-4a39-b1fc-924c97f19f3c tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:12.884811 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7ddc4fd6-89c2-4a39-b1fc-924c97f19f3c tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:12.885452 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7ddc4fd6-89c2-4a39-b1fc-924c97f19f3c tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:12.885906 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7ddc4fd6-89c2-4a39-b1fc-924c97f19f3c tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:13.014674 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-7ddc4fd6-89c2-4a39-b1fc-924c97f19f3c tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:40:13.022117 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-7ddc4fd6-89c2-4a39-b1fc-924c97f19f3c tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c" status: 200 len: 1366 microversion: 2.1 time: 0.149874 Jun 30 18:40:13.022692 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 531/1069] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:12 2022] GET /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:40:13.798881 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-829d493a-f228-47d0-b397-5e2a2ffd29c3 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:13.799511 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-829d493a-f228-47d0-b397-5e2a2ffd29c3 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: ddef212b-cb7c-4978-ab68-1e9db1ea5246] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:13.806265 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-829d493a-f228-47d0-b397-5e2a2ffd29c3 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:13.806637 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-829d493a-f228-47d0-b397-5e2a2ffd29c3 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:13.807386 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-829d493a-f228-47d0-b397-5e2a2ffd29c3 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:13.807815 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-829d493a-f228-47d0-b397-5e2a2ffd29c3 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:13.940707 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-829d493a-f228-47d0-b397-5e2a2ffd29c3 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:40:13.948464 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-829d493a-f228-47d0-b397-5e2a2ffd29c3 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/ddef212b-cb7c-4978-ab68-1e9db1ea5246" status: 200 len: 1265 microversion: 2.1 time: 0.153530 Jun 30 18:40:13.949064 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 539/1070] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:13 2022] GET /compute/v2.1/servers/ddef212b-cb7c-4978-ab68-1e9db1ea5246 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:40:14.040196 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-b645067b-3cf5-45ff-9486-d9feae47c98e tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:14.040804 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-b645067b-3cf5-45ff-9486-d9feae47c98e tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: f83962b1-e24e-41ad-969a-b5d8bc609f2c] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:14.042874 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell0:SELECT=8 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:40:14.050097 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b645067b-3cf5-45ff-9486-d9feae47c98e tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:14.050534 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b645067b-3cf5-45ff-9486-d9feae47c98e tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:14.051295 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b645067b-3cf5-45ff-9486-d9feae47c98e tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:14.051739 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b645067b-3cf5-45ff-9486-d9feae47c98e tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:14.187994 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-b645067b-3cf5-45ff-9486-d9feae47c98e tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:40:14.195398 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-b645067b-3cf5-45ff-9486-d9feae47c98e tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c" status: 200 len: 1366 microversion: 2.1 time: 0.159341 Jun 30 18:40:14.196231 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 532/1071] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:14 2022] GET /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:40:14.528365 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-a22c29e7-6efd-4175-935d-c32059414a13 req-3b7cd7ee-c494-41fd-9f65-6e2b5706c91c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f83962b1-e24e-41ad-969a-b5d8bc609f2c", "name": "network-vif-plugged", "status": "completed", "tag": "9679e7ce-ab18-4116-94b9-2852dee5cfe7"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:40:14.536789 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-a22c29e7-6efd-4175-935d-c32059414a13 req-3b7cd7ee-c494-41fd-9f65-6e2b5706c91c service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:14.537213 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-a22c29e7-6efd-4175-935d-c32059414a13 req-3b7cd7ee-c494-41fd-9f65-6e2b5706c91c service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:14.550211 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.compute.server_external_events [req-a22c29e7-6efd-4175-935d-c32059414a13 req-3b7cd7ee-c494-41fd-9f65-6e2b5706c91c service nova] Creating event network-vif-plugged:9679e7ce-ab18-4116-94b9-2852dee5cfe7 for instance f83962b1-e24e-41ad-969a-b5d8bc609f2c on hv-cinder-80378 Jun 30 18:40:14.555422 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-a22c29e7-6efd-4175-935d-c32059414a13 req-3b7cd7ee-c494-41fd-9f65-6e2b5706c91c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.219713 Jun 30 18:40:14.556056 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 540/1072] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:40:14.965272 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-3d908f3e-fcf0-4718-9fed-efa8be0db0f4 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:14.966097 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-3d908f3e-fcf0-4718-9fed-efa8be0db0f4 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: ddef212b-cb7c-4978-ab68-1e9db1ea5246] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:14.972037 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3d908f3e-fcf0-4718-9fed-efa8be0db0f4 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:14.972914 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3d908f3e-fcf0-4718-9fed-efa8be0db0f4 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:14.973246 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3d908f3e-fcf0-4718-9fed-efa8be0db0f4 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:14.973708 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3d908f3e-fcf0-4718-9fed-efa8be0db0f4 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:15.116504 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-3d908f3e-fcf0-4718-9fed-efa8be0db0f4 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:40:15.123773 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-3d908f3e-fcf0-4718-9fed-efa8be0db0f4 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/ddef212b-cb7c-4978-ab68-1e9db1ea5246" status: 200 len: 1265 microversion: 2.1 time: 0.162413 Jun 30 18:40:15.124328 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 533/1073] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:14 2022] GET /compute/v2.1/servers/ddef212b-cb7c-4978-ab68-1e9db1ea5246 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:40:15.213601 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-4de0d65a-ea37-48fa-9721-f007e56aeab2 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:15.214297 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-4de0d65a-ea37-48fa-9721-f007e56aeab2 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: f83962b1-e24e-41ad-969a-b5d8bc609f2c] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:15.220904 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-4de0d65a-ea37-48fa-9721-f007e56aeab2 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:15.221340 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-4de0d65a-ea37-48fa-9721-f007e56aeab2 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:15.222103 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-4de0d65a-ea37-48fa-9721-f007e56aeab2 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:15.222526 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-4de0d65a-ea37-48fa-9721-f007e56aeab2 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:15.352256 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-4de0d65a-ea37-48fa-9721-f007e56aeab2 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:40:15.360386 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-4de0d65a-ea37-48fa-9721-f007e56aeab2 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c" status: 200 len: 1366 microversion: 2.1 time: 0.150518 Jun 30 18:40:15.360952 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 541/1074] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:15 2022] GET /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:40:16.140808 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-aa59c369-865c-4e5f-a80b-4d6ca323291c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:16.141506 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-aa59c369-865c-4e5f-a80b-4d6ca323291c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: ddef212b-cb7c-4978-ab68-1e9db1ea5246] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:16.148113 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-aa59c369-865c-4e5f-a80b-4d6ca323291c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:16.148560 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-aa59c369-865c-4e5f-a80b-4d6ca323291c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:16.149327 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-aa59c369-865c-4e5f-a80b-4d6ca323291c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:16.149787 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-aa59c369-865c-4e5f-a80b-4d6ca323291c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:16.283333 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-aa59c369-865c-4e5f-a80b-4d6ca323291c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:40:16.290726 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-aa59c369-865c-4e5f-a80b-4d6ca323291c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/ddef212b-cb7c-4978-ab68-1e9db1ea5246" status: 200 len: 1265 microversion: 2.1 time: 0.153823 Jun 30 18:40:16.291297 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 534/1075] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:16 2022] GET /compute/v2.1/servers/ddef212b-cb7c-4978-ab68-1e9db1ea5246 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:40:16.383948 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-8b9870aa-1b2e-4c2f-a0a5-5ea7a3655d31 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:16.384570 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-8b9870aa-1b2e-4c2f-a0a5-5ea7a3655d31 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: f83962b1-e24e-41ad-969a-b5d8bc609f2c] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:16.391541 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8b9870aa-1b2e-4c2f-a0a5-5ea7a3655d31 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:16.391975 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8b9870aa-1b2e-4c2f-a0a5-5ea7a3655d31 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:16.392708 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8b9870aa-1b2e-4c2f-a0a5-5ea7a3655d31 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:16.393131 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-8b9870aa-1b2e-4c2f-a0a5-5ea7a3655d31 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:16.508367 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-6924bdc7-ffb9-4622-b42c-2a54147b09ba tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:40:16.509317 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-6924bdc7-ffb9-4622-b42c-2a54147b09ba tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:16.516335 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6924bdc7-ffb9-4622-b42c-2a54147b09ba tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:16.516875 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6924bdc7-ffb9-4622-b42c-2a54147b09ba tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:16.517677 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6924bdc7-ffb9-4622-b42c-2a54147b09ba tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:16.518147 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6924bdc7-ffb9-4622-b42c-2a54147b09ba tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:16.520204 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-8b9870aa-1b2e-4c2f-a0a5-5ea7a3655d31 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:40:16.527545 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-8b9870aa-1b2e-4c2f-a0a5-5ea7a3655d31 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c" status: 200 len: 1366 microversion: 2.1 time: 0.147338 Jun 30 18:40:16.528250 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 542/1076] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:16 2022] GET /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:40:16.571195 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-ccbf07fe-a69a-41be-9574-e728c623881f req-9b0666df-d178-4bc4-833a-dfd20c55cb2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddef212b-cb7c-4978-ab68-1e9db1ea5246", "name": "network-vif-plugged", "status": "completed", "tag": "9c6eff65-98fe-438e-96c1-652f799ad853"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:40:16.579841 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-ccbf07fe-a69a-41be-9574-e728c623881f req-9b0666df-d178-4bc4-833a-dfd20c55cb2c service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:16.580276 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-ccbf07fe-a69a-41be-9574-e728c623881f req-9b0666df-d178-4bc4-833a-dfd20c55cb2c service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:16.591124 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.compute.server_external_events [req-ccbf07fe-a69a-41be-9574-e728c623881f req-9b0666df-d178-4bc4-833a-dfd20c55cb2c service nova] Creating event network-vif-plugged:9c6eff65-98fe-438e-96c1-652f799ad853 for instance ddef212b-cb7c-4978-ab68-1e9db1ea5246 on hv-cinder-80378 Jun 30 18:40:16.595348 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-6924bdc7-ffb9-4622-b42c-2a54147b09ba tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "POST /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f/action" status: 202 len: 0 microversion: 2.1 time: 0.090744 Jun 30 18:40:16.595989 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 535/1077] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 30 18:40:16 2022] POST /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 30 18:40:16.596727 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-ccbf07fe-a69a-41be-9574-e728c623881f req-9b0666df-d178-4bc4-833a-dfd20c55cb2c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030696 Jun 30 18:40:16.597347 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 543/1078] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:40:16.603955 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-8da47685-6501-4695-a7c0-b4561c652c60 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:16.604663 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-8da47685-6501-4695-a7c0-b4561c652c60 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:16.611324 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8da47685-6501-4695-a7c0-b4561c652c60 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:16.611754 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8da47685-6501-4695-a7c0-b4561c652c60 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:16.612498 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8da47685-6501-4695-a7c0-b4561c652c60 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:16.612924 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8da47685-6501-4695-a7c0-b4561c652c60 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:16.758429 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-8da47685-6501-4695-a7c0-b4561c652c60 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784fdfd56b3d4ae4b6f68b66c4f06ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666edd3825ba4e32ac180ed230d93e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:40:16.767141 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-8da47685-6501-4695-a7c0-b4561c652c60 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 200 len: 1752 microversion: 2.1 time: 0.166917 Jun 30 18:40:16.767714 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 536/1079] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:16 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 1752 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:40:17.308992 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-2bde01d1-c8fb-4148-90c3-c31720b0ca1d tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:17.310010 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-2bde01d1-c8fb-4148-90c3-c31720b0ca1d tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: ddef212b-cb7c-4978-ab68-1e9db1ea5246] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:17.317487 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2bde01d1-c8fb-4148-90c3-c31720b0ca1d tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:17.317964 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2bde01d1-c8fb-4148-90c3-c31720b0ca1d tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:17.319858 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2bde01d1-c8fb-4148-90c3-c31720b0ca1d tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:17.319858 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2bde01d1-c8fb-4148-90c3-c31720b0ca1d tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:17.502496 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-2bde01d1-c8fb-4148-90c3-c31720b0ca1d tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:40:17.509882 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-2bde01d1-c8fb-4148-90c3-c31720b0ca1d tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/ddef212b-cb7c-4978-ab68-1e9db1ea5246" status: 200 len: 1265 microversion: 2.1 time: 0.205131 Jun 30 18:40:17.510445 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 544/1080] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:17 2022] GET /compute/v2.1/servers/ddef212b-cb7c-4978-ab68-1e9db1ea5246 => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:40:17.544639 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-0fb5b6db-c982-46af-a3f9-d5fb54ea089a tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:17.545179 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-0fb5b6db-c982-46af-a3f9-d5fb54ea089a tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: f83962b1-e24e-41ad-969a-b5d8bc609f2c] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:17.552556 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0fb5b6db-c982-46af-a3f9-d5fb54ea089a tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:17.553167 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0fb5b6db-c982-46af-a3f9-d5fb54ea089a tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:17.554072 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0fb5b6db-c982-46af-a3f9-d5fb54ea089a tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:17.554553 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0fb5b6db-c982-46af-a3f9-d5fb54ea089a tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:17.688074 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-0fb5b6db-c982-46af-a3f9-d5fb54ea089a tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:40:17.695592 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-0fb5b6db-c982-46af-a3f9-d5fb54ea089a tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c" status: 200 len: 1555 microversion: 2.1 time: 0.154625 Jun 30 18:40:17.696154 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 537/1081] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:17 2022] GET /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:40:17.716343 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-a955891d-5911-4c69-9771-f7d3d289d454 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:17.716902 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-a955891d-5911-4c69-9771-f7d3d289d454 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: f83962b1-e24e-41ad-969a-b5d8bc609f2c] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:17.723941 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a955891d-5911-4c69-9771-f7d3d289d454 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:17.724386 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a955891d-5911-4c69-9771-f7d3d289d454 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:17.725147 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a955891d-5911-4c69-9771-f7d3d289d454 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:17.725598 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a955891d-5911-4c69-9771-f7d3d289d454 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:17.784942 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-9ec09051-96fd-4ffd-b622-7756e08980c1 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:17.785817 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-9ec09051-96fd-4ffd-b622-7756e08980c1 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:17.791640 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9ec09051-96fd-4ffd-b622-7756e08980c1 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:17.792086 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9ec09051-96fd-4ffd-b622-7756e08980c1 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:17.792847 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9ec09051-96fd-4ffd-b622-7756e08980c1 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:17.793277 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9ec09051-96fd-4ffd-b622-7756e08980c1 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:17.802653 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-a955891d-5911-4c69-9771-f7d3d289d454 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093347 Jun 30 18:40:17.803246 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 545/1082] 10.222.0.33 () {58 vars in 1274 bytes} [Thu Jun 30 18:40:17 2022] GET /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:40:18.129841 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-9ec09051-96fd-4ffd-b622-7756e08980c1 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784fdfd56b3d4ae4b6f68b66c4f06ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666edd3825ba4e32ac180ed230d93e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:40:18.138257 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-9ec09051-96fd-4ffd-b622-7756e08980c1 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 200 len: 1752 microversion: 2.1 time: 0.357847 Jun 30 18:40:18.138840 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 538/1083] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:17 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 1752 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:40:18.527988 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-5df719ea-7799-4fec-b939-24eac6943579 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:18.528610 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-5df719ea-7799-4fec-b939-24eac6943579 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: ddef212b-cb7c-4978-ab68-1e9db1ea5246] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:18.535076 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-5df719ea-7799-4fec-b939-24eac6943579 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:18.535517 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-5df719ea-7799-4fec-b939-24eac6943579 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:18.536268 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-5df719ea-7799-4fec-b939-24eac6943579 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:18.536689 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-5df719ea-7799-4fec-b939-24eac6943579 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:18.748108 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-5df719ea-7799-4fec-b939-24eac6943579 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:40:18.756895 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-5df719ea-7799-4fec-b939-24eac6943579 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/ddef212b-cb7c-4978-ab68-1e9db1ea5246" status: 200 len: 1265 microversion: 2.1 time: 0.233248 Jun 30 18:40:18.757474 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 546/1084] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:18 2022] GET /compute/v2.1/servers/ddef212b-cb7c-4978-ab68-1e9db1ea5246 => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:40:18.955687 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [req-e188b655-0235-44ec-8129-edea6fabefab req-07e71d9f-46cc-4f13-8117-3dc08c770ad5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f83962b1-e24e-41ad-969a-b5d8bc609f2c", "tag": "9679e7ce-ab18-4116-94b9-2852dee5cfe7"}]} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:40:18.963611 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-e188b655-0235-44ec-8129-edea6fabefab req-07e71d9f-46cc-4f13-8117-3dc08c770ad5 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:18.964250 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-e188b655-0235-44ec-8129-edea6fabefab req-07e71d9f-46cc-4f13-8117-3dc08c770ad5 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:18.975983 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.compute.server_external_events [req-e188b655-0235-44ec-8129-edea6fabefab req-07e71d9f-46cc-4f13-8117-3dc08c770ad5 service nova] Creating event network-changed:9679e7ce-ab18-4116-94b9-2852dee5cfe7 for instance f83962b1-e24e-41ad-969a-b5d8bc609f2c on hv-cinder-80378 Jun 30 18:40:18.981077 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [req-e188b655-0235-44ec-8129-edea6fabefab req-07e71d9f-46cc-4f13-8117-3dc08c770ad5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089841 Jun 30 18:40:18.981691 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 539/1085] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:40:19.156633 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-33675a0f-b22e-48f8-aa02-16d07ccf2604 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:19.157687 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-33675a0f-b22e-48f8-aa02-16d07ccf2604 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:19.163700 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-33675a0f-b22e-48f8-aa02-16d07ccf2604 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:19.164146 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-33675a0f-b22e-48f8-aa02-16d07ccf2604 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:19.164913 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-33675a0f-b22e-48f8-aa02-16d07ccf2604 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:19.165344 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-33675a0f-b22e-48f8-aa02-16d07ccf2604 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:19.315396 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-33675a0f-b22e-48f8-aa02-16d07ccf2604 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784fdfd56b3d4ae4b6f68b66c4f06ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666edd3825ba4e32ac180ed230d93e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:40:19.323983 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-33675a0f-b22e-48f8-aa02-16d07ccf2604 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 200 len: 1757 microversion: 2.1 time: 0.171898 Jun 30 18:40:19.324552 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 547/1086] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:19 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:40:19.774300 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-0d394afa-a418-47b3-89ac-eeb16b539b58 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:19.775179 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-0d394afa-a418-47b3-89ac-eeb16b539b58 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: ddef212b-cb7c-4978-ab68-1e9db1ea5246] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:19.785538 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0d394afa-a418-47b3-89ac-eeb16b539b58 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:19.785910 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0d394afa-a418-47b3-89ac-eeb16b539b58 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:19.786685 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0d394afa-a418-47b3-89ac-eeb16b539b58 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:19.787119 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0d394afa-a418-47b3-89ac-eeb16b539b58 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:20.183561 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-0d394afa-a418-47b3-89ac-eeb16b539b58 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:40:20.192074 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-0d394afa-a418-47b3-89ac-eeb16b539b58 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/ddef212b-cb7c-4978-ab68-1e9db1ea5246" status: 200 len: 1451 microversion: 2.1 time: 0.421972 Jun 30 18:40:20.192661 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 540/1087] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:19 2022] GET /compute/v2.1/servers/ddef212b-cb7c-4978-ab68-1e9db1ea5246 => generated 1451 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:40:20.208354 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-679cee83-1d52-4e98-b49c-9e1dded9956b tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:20.208992 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-679cee83-1d52-4e98-b49c-9e1dded9956b tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: ddef212b-cb7c-4978-ab68-1e9db1ea5246] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:20.215450 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-679cee83-1d52-4e98-b49c-9e1dded9956b tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:20.215898 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-679cee83-1d52-4e98-b49c-9e1dded9956b tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:20.216683 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-679cee83-1d52-4e98-b49c-9e1dded9956b tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:20.217112 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-679cee83-1d52-4e98-b49c-9e1dded9956b tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:20.239583 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell1:SELECT=100 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:40:20.340152 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-161de44d-7bef-4f53-a43a-e6529923831f tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:20.340989 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-161de44d-7bef-4f53-a43a-e6529923831f tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:20.347128 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-161de44d-7bef-4f53-a43a-e6529923831f tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:20.347578 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-161de44d-7bef-4f53-a43a-e6529923831f tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:20.348348 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-161de44d-7bef-4f53-a43a-e6529923831f tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:20.348783 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-161de44d-7bef-4f53-a43a-e6529923831f tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:20.351756 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-679cee83-1d52-4e98-b49c-9e1dded9956b tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:40:20.360399 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-679cee83-1d52-4e98-b49c-9e1dded9956b tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/ddef212b-cb7c-4978-ab68-1e9db1ea5246" status: 200 len: 1451 microversion: 2.1 time: 0.155887 Jun 30 18:40:20.360976 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 548/1088] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:20 2022] GET /compute/v2.1/servers/ddef212b-cb7c-4978-ab68-1e9db1ea5246 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:40:20.495672 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-161de44d-7bef-4f53-a43a-e6529923831f tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784fdfd56b3d4ae4b6f68b66c4f06ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666edd3825ba4e32ac180ed230d93e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:40:20.503585 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-161de44d-7bef-4f53-a43a-e6529923831f tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 200 len: 1757 microversion: 2.1 time: 0.167275 Jun 30 18:40:20.504155 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 541/1089] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:20 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:40:21.521481 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-e2b4517c-e745-40c5-9429-0b1d043bb71e tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:21.522149 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-e2b4517c-e745-40c5-9429-0b1d043bb71e tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:21.528586 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e2b4517c-e745-40c5-9429-0b1d043bb71e tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:21.529034 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e2b4517c-e745-40c5-9429-0b1d043bb71e tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:21.529822 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e2b4517c-e745-40c5-9429-0b1d043bb71e tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:21.530683 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e2b4517c-e745-40c5-9429-0b1d043bb71e tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:21.798114 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-e2b4517c-e745-40c5-9429-0b1d043bb71e tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784fdfd56b3d4ae4b6f68b66c4f06ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666edd3825ba4e32ac180ed230d93e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:40:21.806054 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-e2b4517c-e745-40c5-9429-0b1d043bb71e tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 200 len: 1757 microversion: 2.1 time: 0.288451 Jun 30 18:40:21.806621 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 549/1090] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:21 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 1757 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:40:22.169090 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [req-5d78c88f-00f4-4afd-84e8-0e0912b0ff70 req-16295715-d525-4273-b920-950a51d177bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddef212b-cb7c-4978-ab68-1e9db1ea5246", "tag": "9c6eff65-98fe-438e-96c1-652f799ad853"}]} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:40:22.178630 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-5d78c88f-00f4-4afd-84e8-0e0912b0ff70 req-16295715-d525-4273-b920-950a51d177bb service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:22.179480 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-5d78c88f-00f4-4afd-84e8-0e0912b0ff70 req-16295715-d525-4273-b920-950a51d177bb service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:22.191587 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.compute.server_external_events [req-5d78c88f-00f4-4afd-84e8-0e0912b0ff70 req-16295715-d525-4273-b920-950a51d177bb service nova] Creating event network-changed:9c6eff65-98fe-438e-96c1-652f799ad853 for instance ddef212b-cb7c-4978-ab68-1e9db1ea5246 on hv-cinder-80378 Jun 30 18:40:22.196994 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [req-5d78c88f-00f4-4afd-84e8-0e0912b0ff70 req-16295715-d525-4273-b920-950a51d177bb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031663 Jun 30 18:40:22.197749 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 542/1091] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:40:22.824428 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-0e695864-6236-4c1d-a66d-d8c509a9f4cb tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:22.825831 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-0e695864-6236-4c1d-a66d-d8c509a9f4cb tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:22.832775 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0e695864-6236-4c1d-a66d-d8c509a9f4cb tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:22.833216 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0e695864-6236-4c1d-a66d-d8c509a9f4cb tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:22.833997 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0e695864-6236-4c1d-a66d-d8c509a9f4cb tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:22.834421 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0e695864-6236-4c1d-a66d-d8c509a9f4cb tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:22.993415 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-0e695864-6236-4c1d-a66d-d8c509a9f4cb tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784fdfd56b3d4ae4b6f68b66c4f06ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666edd3825ba4e32ac180ed230d93e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:40:23.005385 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-0e695864-6236-4c1d-a66d-d8c509a9f4cb tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 200 len: 1757 microversion: 2.1 time: 0.184866 Jun 30 18:40:23.006124 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 550/1092] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:22 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 1757 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:40:24.023756 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-7aa3767a-e0d5-4c9e-bc83-1bf5316d268a tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:24.024460 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-7aa3767a-e0d5-4c9e-bc83-1bf5316d268a tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:24.032084 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7aa3767a-e0d5-4c9e-bc83-1bf5316d268a tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:24.032532 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7aa3767a-e0d5-4c9e-bc83-1bf5316d268a tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:24.033296 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7aa3767a-e0d5-4c9e-bc83-1bf5316d268a tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:24.033779 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7aa3767a-e0d5-4c9e-bc83-1bf5316d268a tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:24.178526 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-7aa3767a-e0d5-4c9e-bc83-1bf5316d268a tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784fdfd56b3d4ae4b6f68b66c4f06ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666edd3825ba4e32ac180ed230d93e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:40:24.186373 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-7aa3767a-e0d5-4c9e-bc83-1bf5316d268a tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 200 len: 1757 microversion: 2.1 time: 0.167433 Jun 30 18:40:24.186962 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 543/1093] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:24 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:40:25.203754 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-320205d6-facd-4db2-9a45-8478dc703331 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:25.204363 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-320205d6-facd-4db2-9a45-8478dc703331 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:25.210891 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-320205d6-facd-4db2-9a45-8478dc703331 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:25.211336 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-320205d6-facd-4db2-9a45-8478dc703331 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:25.212091 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-320205d6-facd-4db2-9a45-8478dc703331 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:25.212542 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-320205d6-facd-4db2-9a45-8478dc703331 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:25.353971 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-320205d6-facd-4db2-9a45-8478dc703331 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784fdfd56b3d4ae4b6f68b66c4f06ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666edd3825ba4e32ac180ed230d93e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:40:25.362310 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-320205d6-facd-4db2-9a45-8478dc703331 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 200 len: 1757 microversion: 2.1 time: 0.162575 Jun 30 18:40:25.362873 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 551/1094] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:25 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:40:26.379727 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-27b6ee89-2711-4ccb-8dc3-bed920b3b80f tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:26.380338 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-27b6ee89-2711-4ccb-8dc3-bed920b3b80f tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:26.386530 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-27b6ee89-2711-4ccb-8dc3-bed920b3b80f tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:26.386981 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-27b6ee89-2711-4ccb-8dc3-bed920b3b80f tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:26.387738 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-27b6ee89-2711-4ccb-8dc3-bed920b3b80f tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:26.388175 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-27b6ee89-2711-4ccb-8dc3-bed920b3b80f tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:26.526556 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-27b6ee89-2711-4ccb-8dc3-bed920b3b80f tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784fdfd56b3d4ae4b6f68b66c4f06ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666edd3825ba4e32ac180ed230d93e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:40:26.535484 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-27b6ee89-2711-4ccb-8dc3-bed920b3b80f tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 200 len: 1757 microversion: 2.1 time: 0.159612 Jun 30 18:40:26.536046 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 544/1095] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:26 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 1757 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:40:27.553001 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-60488d51-c8a9-4aea-b8ed-1afb2f0fb7af tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:27.553665 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-60488d51-c8a9-4aea-b8ed-1afb2f0fb7af tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:27.560329 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-60488d51-c8a9-4aea-b8ed-1afb2f0fb7af tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:27.560867 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-60488d51-c8a9-4aea-b8ed-1afb2f0fb7af tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:27.561646 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-60488d51-c8a9-4aea-b8ed-1afb2f0fb7af tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:27.562079 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-60488d51-c8a9-4aea-b8ed-1afb2f0fb7af tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:27.709936 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-60488d51-c8a9-4aea-b8ed-1afb2f0fb7af tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784fdfd56b3d4ae4b6f68b66c4f06ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666edd3825ba4e32ac180ed230d93e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:40:27.721132 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-60488d51-c8a9-4aea-b8ed-1afb2f0fb7af tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 200 len: 1757 microversion: 2.1 time: 0.172009 Jun 30 18:40:27.721732 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 552/1096] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:27 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:40:28.738929 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-b6d6f685-a6f9-432c-baba-f6359e35bed3 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:28.739531 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-b6d6f685-a6f9-432c-baba-f6359e35bed3 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:28.746074 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b6d6f685-a6f9-432c-baba-f6359e35bed3 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:28.746548 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b6d6f685-a6f9-432c-baba-f6359e35bed3 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:28.747426 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b6d6f685-a6f9-432c-baba-f6359e35bed3 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:28.747888 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b6d6f685-a6f9-432c-baba-f6359e35bed3 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:28.751892 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:40:28.892675 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-b6d6f685-a6f9-432c-baba-f6359e35bed3 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784fdfd56b3d4ae4b6f68b66c4f06ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666edd3825ba4e32ac180ed230d93e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:40:28.900594 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-b6d6f685-a6f9-432c-baba-f6359e35bed3 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 200 len: 1757 microversion: 2.1 time: 0.165593 Jun 30 18:40:28.901162 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 545/1097] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:28 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:40:29.918496 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-9ba51774-a27f-4385-8094-572209f2d53a tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:29.919050 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-9ba51774-a27f-4385-8094-572209f2d53a tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:29.926268 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9ba51774-a27f-4385-8094-572209f2d53a tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:29.926691 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9ba51774-a27f-4385-8094-572209f2d53a tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:29.927452 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9ba51774-a27f-4385-8094-572209f2d53a tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:29.927886 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9ba51774-a27f-4385-8094-572209f2d53a tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:30.098729 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-9ba51774-a27f-4385-8094-572209f2d53a tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784fdfd56b3d4ae4b6f68b66c4f06ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666edd3825ba4e32ac180ed230d93e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:40:30.107235 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-9ba51774-a27f-4385-8094-572209f2d53a tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 200 len: 1757 microversion: 2.1 time: 0.192115 Jun 30 18:40:30.107727 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 553/1098] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:29 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 1757 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:40:31.124786 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-3c5cccb7-3cbb-41bb-ad9d-ee9854584d5d tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:31.125399 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-3c5cccb7-3cbb-41bb-ad9d-ee9854584d5d tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:31.131942 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3c5cccb7-3cbb-41bb-ad9d-ee9854584d5d tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:31.132389 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3c5cccb7-3cbb-41bb-ad9d-ee9854584d5d tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:31.133147 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3c5cccb7-3cbb-41bb-ad9d-ee9854584d5d tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:31.133601 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3c5cccb7-3cbb-41bb-ad9d-ee9854584d5d tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:31.275427 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-3c5cccb7-3cbb-41bb-ad9d-ee9854584d5d tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784fdfd56b3d4ae4b6f68b66c4f06ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666edd3825ba4e32ac180ed230d93e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:40:31.283568 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-3c5cccb7-3cbb-41bb-ad9d-ee9854584d5d tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 200 len: 1760 microversion: 2.1 time: 0.163264 Jun 30 18:40:31.284166 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 546/1099] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:31 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 1760 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:41:34.160570 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_api:SELECT=35 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:41:34.161311 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell1:SELECT=32 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:41:34.165529 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-9531117f-d32c-4d62-9dfc-61377e305dc9 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:41:34.166034 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-9531117f-d32c-4d62-9dfc-61377e305dc9 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: f83962b1-e24e-41ad-969a-b5d8bc609f2c] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:41:34.172588 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9531117f-d32c-4d62-9dfc-61377e305dc9 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:34.173023 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9531117f-d32c-4d62-9dfc-61377e305dc9 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:34.173803 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9531117f-d32c-4d62-9dfc-61377e305dc9 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:34.174233 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9531117f-d32c-4d62-9dfc-61377e305dc9 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:34.197432 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-9531117f-d32c-4d62-9dfc-61377e305dc9 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c/ips" status: 200 len: 149 microversion: 2.1 time: 0.038647 Jun 30 18:41:34.198110 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 554/1100] 10.222.0.33 () {58 vars in 1247 bytes} [Thu Jun 30 18:41:34 2022] GET /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:41:35.536665 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_api:SELECT=37 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:41:35.538167 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell1:SELECT=11 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:41:35.542958 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-3ad7c3ca-3100-4b04-9abb-44a500db7b78 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be142546-76cd-452e-8bef-348e924f5787"}} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:41:35.544059 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-3ad7c3ca-3100-4b04-9abb-44a500db7b78 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: f83962b1-e24e-41ad-969a-b5d8bc609f2c] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:41:35.550827 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3ad7c3ca-3100-4b04-9abb-44a500db7b78 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:35.551275 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3ad7c3ca-3100-4b04-9abb-44a500db7b78 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:35.552026 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3ad7c3ca-3100-4b04-9abb-44a500db7b78 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:35.552458 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3ad7c3ca-3100-4b04-9abb-44a500db7b78 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:35.829106 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-3ad7c3ca-3100-4b04-9abb-44a500db7b78 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "POST /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293898 Jun 30 18:41:35.829985 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 547/1101] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 30 18:41:35 2022] POST /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:41:38.707237 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-1e64e3fc-7a65-41d8-9129-2851f8cfaefb tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1274187528"}} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:41:38.707803 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-1e64e3fc-7a65-41d8-9129-2851f8cfaefb tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:41:38.714235 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1e64e3fc-7a65-41d8-9129-2851f8cfaefb tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:38.714678 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1e64e3fc-7a65-41d8-9129-2851f8cfaefb tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:38.715424 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1e64e3fc-7a65-41d8-9129-2851f8cfaefb tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:38.715853 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1e64e3fc-7a65-41d8-9129-2851f8cfaefb tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:38.842305 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.network.security_group_api [None req-1e64e3fc-7a65-41d8-9129-2851f8cfaefb tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Removing security group 761808d1-901c-45dd-88c7-48f8dac98ece from port 66b87a68-1890-42c6-b759-72e44f506ff1 Jun 30 18:41:39.197271 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-1e64e3fc-7a65-41d8-9129-2851f8cfaefb tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "POST /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f/action" status: 202 len: 0 microversion: 2.1 time: 0.494161 Jun 30 18:41:39.203064 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 555/1102] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 30 18:41:38 2022] POST /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f/action => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 18:41:39.211668 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [req-a7791cd4-7e7c-4cab-bf55-96dfa222e804 req-aadd738f-7853-4aff-ae1a-7155a467315d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4a22a51-62b8-4ad0-88e4-f959b6cc606f", "tag": "66b87a68-1890-42c6-b759-72e44f506ff1"}]} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:41:39.225855 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-a7791cd4-7e7c-4cab-bf55-96dfa222e804 req-aadd738f-7853-4aff-ae1a-7155a467315d service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:39.228823 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-a7791cd4-7e7c-4cab-bf55-96dfa222e804 req-aadd738f-7853-4aff-ae1a-7155a467315d service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:39.251829 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.compute.server_external_events [req-a7791cd4-7e7c-4cab-bf55-96dfa222e804 req-aadd738f-7853-4aff-ae1a-7155a467315d service nova] Creating event network-changed:66b87a68-1890-42c6-b759-72e44f506ff1 for instance c4a22a51-62b8-4ad0-88e4-f959b6cc606f on hv-cinder-80378 Jun 30 18:41:39.261708 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [req-a7791cd4-7e7c-4cab-bf55-96dfa222e804 req-aadd738f-7853-4aff-ae1a-7155a467315d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061424 Jun 30 18:41:39.263035 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 548/1103] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:41:40.342829 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-d8730021-2cf7-44af-a6b2-92b731fc13ec tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:41:40.343367 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-d8730021-2cf7-44af-a6b2-92b731fc13ec tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:41:40.349888 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d8730021-2cf7-44af-a6b2-92b731fc13ec tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:40.350924 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d8730021-2cf7-44af-a6b2-92b731fc13ec tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:40.351722 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d8730021-2cf7-44af-a6b2-92b731fc13ec tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:40.352155 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d8730021-2cf7-44af-a6b2-92b731fc13ec tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:40.435151 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.objects.instance [None req-d8730021-2cf7-44af-a6b2-92b731fc13ec tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lazy-loading 'services' on Instance uuid c4a22a51-62b8-4ad0-88e4-f959b6cc606f {{(pid=117941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 18:41:40.510242 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-d8730021-2cf7-44af-a6b2-92b731fc13ec tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f/os-volume_attachments/dc0e93d6-bc1e-4978-9c43-1511667bb441" status: 202 len: 0 microversion: 2.1 time: 0.172825 Jun 30 18:41:40.510838 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 556/1104] 10.222.0.33 () {58 vars in 1415 bytes} [Thu Jun 30 18:41:40 2022] DELETE /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f/os-volume_attachments/dc0e93d6-bc1e-4978-9c43-1511667bb441 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 18:41:40.519639 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-fe36eaff-4fae-4f8e-862a-be056d10c066 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:41:40.520738 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-fe36eaff-4fae-4f8e-862a-be056d10c066 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:41:40.527316 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fe36eaff-4fae-4f8e-862a-be056d10c066 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:40.527763 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fe36eaff-4fae-4f8e-862a-be056d10c066 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:40.528528 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fe36eaff-4fae-4f8e-862a-be056d10c066 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:40.528962 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fe36eaff-4fae-4f8e-862a-be056d10c066 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:40.559890 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-fe36eaff-4fae-4f8e-862a-be056d10c066 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044300 Jun 30 18:41:40.560361 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 549/1105] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 30 18:41:40 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:41:41.284147 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-82924dfb-f907-4755-8781-fbc4f83baf77 req-c7c74bbd-790a-48b3-a26e-01d0a409bf23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4a22a51-62b8-4ad0-88e4-f959b6cc606f", "tag": "66b87a68-1890-42c6-b759-72e44f506ff1"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:41:41.296003 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-82924dfb-f907-4755-8781-fbc4f83baf77 req-c7c74bbd-790a-48b3-a26e-01d0a409bf23 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:41.296451 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-82924dfb-f907-4755-8781-fbc4f83baf77 req-c7c74bbd-790a-48b3-a26e-01d0a409bf23 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:41.307788 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.compute.server_external_events [req-82924dfb-f907-4755-8781-fbc4f83baf77 req-c7c74bbd-790a-48b3-a26e-01d0a409bf23 service nova] Creating event network-changed:66b87a68-1890-42c6-b759-72e44f506ff1 for instance c4a22a51-62b8-4ad0-88e4-f959b6cc606f on hv-cinder-80378 Jun 30 18:41:41.312906 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-82924dfb-f907-4755-8781-fbc4f83baf77 req-c7c74bbd-790a-48b3-a26e-01d0a409bf23 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034950 Jun 30 18:41:41.313884 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 557/1106] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:41:41.572271 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-beabce66-db67-405b-b6fe-83ed4c91f1e3 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:41:41.573264 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-beabce66-db67-405b-b6fe-83ed4c91f1e3 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:41:41.579588 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-beabce66-db67-405b-b6fe-83ed4c91f1e3 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:41.580026 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-beabce66-db67-405b-b6fe-83ed4c91f1e3 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:41.580803 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-beabce66-db67-405b-b6fe-83ed4c91f1e3 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:41.581347 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-beabce66-db67-405b-b6fe-83ed4c91f1e3 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:41.610284 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-beabce66-db67-405b-b6fe-83ed4c91f1e3 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042690 Jun 30 18:41:41.610848 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 550/1107] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 30 18:41:41 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:41:42.623065 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-67d08835-eb7f-44d7-992d-9a3dc7b1d7a6 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:41:42.624062 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-67d08835-eb7f-44d7-992d-9a3dc7b1d7a6 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:41:42.630244 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-67d08835-eb7f-44d7-992d-9a3dc7b1d7a6 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:42.630687 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-67d08835-eb7f-44d7-992d-9a3dc7b1d7a6 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:42.631434 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-67d08835-eb7f-44d7-992d-9a3dc7b1d7a6 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:42.631867 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-67d08835-eb7f-44d7-992d-9a3dc7b1d7a6 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:42.659929 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-67d08835-eb7f-44d7-992d-9a3dc7b1d7a6 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041634 Jun 30 18:41:42.660475 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 558/1108] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 30 18:41:42 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:41:43.332064 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-d63fc292-4120-4b00-837c-6bd8bfb23307 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Action: 'create', calling method: .version_select at 0x7f1804c7fe50>, body: {"keypair": {"name": "tempest-keypair-1112874546", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOS5JauWTBnAH95kb4y/ExFB8Cok0ClX5K3X1ymhZ8NOBH4hkP3aQxVPmhdJvYe30TqS/o3/0W06dUauYGOwOEgw+o5HojwsMvRxNLsVjLQkhafcKYVfYs1vboMew7w74g=="}} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:41:43.346182 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.quota [None req-d63fc292-4120-4b00-837c-6bd8bfb23307 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Getting quotas for project b8227be3d9a044ed888b2f54abd9463d. Resources: {'key_pairs'} {{(pid=117940) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 18:41:43.350270 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.quota [None req-d63fc292-4120-4b00-837c-6bd8bfb23307 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Getting quotas for user 9531d18446eb4488bbd1511cb3412925 and project b8227be3d9a044ed888b2f54abd9463d. Resources: {'key_pairs'} {{(pid=117940) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 18:41:43.372048 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-d63fc292-4120-4b00-837c-6bd8bfb23307 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043796 Jun 30 18:41:43.372641 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 551/1109] 10.222.0.33 () {60 vars in 1158 bytes} [Thu Jun 30 18:41:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:41:43.672753 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-eb45ffd6-321b-4aa4-9f1f-12a7865714ac tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:41:43.673733 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-eb45ffd6-321b-4aa4-9f1f-12a7865714ac tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:41:43.680236 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-eb45ffd6-321b-4aa4-9f1f-12a7865714ac tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:43.680672 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-eb45ffd6-321b-4aa4-9f1f-12a7865714ac tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:43.681426 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-eb45ffd6-321b-4aa4-9f1f-12a7865714ac tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:43.681870 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-eb45ffd6-321b-4aa4-9f1f-12a7865714ac tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:43.713510 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-eb45ffd6-321b-4aa4-9f1f-12a7865714ac tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044980 Jun 30 18:41:43.714408 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 559/1110] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 30 18:41:43 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:41:44.702943 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-4f7a9d93-1313-49dd-b6db-abb92bef1de5 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1772951605", "imageRef": "636d6d52-5033-47e1-bf75-0b4fc50c0bb0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c75ba402-1254-4901-ad58-40e30172cc26"}], "security_groups": [{"name": "tempest-securitygroup--457649432"}], "key_name": "tempest-keypair-1112874546", "user_data": "}} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:41:44.724343 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-1dc076e4-72d8-46c0-aa1b-c22950d50671 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:41:44.725364 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-1dc076e4-72d8-46c0-aa1b-c22950d50671 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:41:44.732196 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1dc076e4-72d8-46c0-aa1b-c22950d50671 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:44.732634 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1dc076e4-72d8-46c0-aa1b-c22950d50671 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:44.733407 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1dc076e4-72d8-46c0-aa1b-c22950d50671 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:44.733859 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1dc076e4-72d8-46c0-aa1b-c22950d50671 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:44.763296 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-1dc076e4-72d8-46c0-aa1b-c22950d50671 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042901 Jun 30 18:41:44.763842 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 560/1111] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 30 18:41:44 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 30 18:41:44.774283 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-54ee8f3e-2063-4b1f-8719-622a119d7c61 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:41:44.774856 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-54ee8f3e-2063-4b1f-8719-622a119d7c61 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:41:44.780947 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-54ee8f3e-2063-4b1f-8719-622a119d7c61 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:44.781478 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-54ee8f3e-2063-4b1f-8719-622a119d7c61 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:44.782323 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-54ee8f3e-2063-4b1f-8719-622a119d7c61 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:44.782821 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-54ee8f3e-2063-4b1f-8719-622a119d7c61 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:44.810804 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.network.neutron [None req-4f7a9d93-1313-49dd-b6db-abb92bef1de5 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] validate_networks() for [('c75ba402-1254-4901-ad58-40e30172cc26', None, None, None, None, None)] {{(pid=117940) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 18:41:44.862938 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.wsgi [None req-54ee8f3e-2063-4b1f-8719-622a119d7c61 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] HTTP exception thrown: Instance c4a22a51-62b8-4ad0-88e4-f959b6cc606f is not attached to volume dc0e93d6-bc1e-4978-9c43-1511667bb441 Jun 30 18:41:44.868402 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-54ee8f3e-2063-4b1f-8719-622a119d7c61 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Request method failure captured: Jun 30 18:41:44.868402 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: request: DELETE /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f/os-volume_attachments/dc0e93d6-bc1e-4978-9c43-1511667bb441 HTTP/1.1 Jun 30 18:41:44.868402 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept: application/json Jun 30 18:41:44.868402 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept-Encoding: identity Jun 30 18:41:44.868402 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Connection: close Jun 30 18:41:44.868402 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Length: 0 Jun 30 18:41:44.868402 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Type: application/json Jun 30 18:41:44.868402 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Host: 10.222.0.33 Jun 30 18:41:44.868402 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Openstack-System-Scope: None Jun 30 18:41:44.868402 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: User-Agent: python-urllib3/1.26.9 Jun 30 18:41:44.868402 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Auth-Token: gAAAAABive1-2Bmt6ede_eIoqwT8NKAvBAl7tSWbmUU2eUAc8Z0Bim6WKX8jiM-Sqp3hD74CZbL5uu_eQXJqNJ4w1moDKJ9SRbQZ85nY1GYiKRaloferwIAkZwHd-Mp7b1uLc3JczQdUhuJm86ps0sLeWPrmu3_lcIDmAgTNcO5qjwvIslrP-Zg Jun 30 18:41:44.868402 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Id: None Jun 30 18:41:44.868402 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Name: None Jun 30 18:41:44.868402 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Identity-Status: Confirmed Jun 30 18:41:44.868402 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Is-Admin-Project: True Jun 30 18:41:44.868402 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Id: default Jun 30 18:41:44.868402 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Name: Default Jun 30 18:41:44.868402 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Id: 666edd3825ba4e32ac180ed230d93e85 Jun 30 18:41:44.868402 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Name: tempest-TestMinimumBasicScenario-1969508574 Jun 30 18:41:44.868402 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Role: reader,member Jun 30 18:41:44.868402 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Roles: reader,member Jun 30 18:41:44.870167 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/666edd3825ba4e32ac180ed230d93e85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_666edd3825ba4e32ac180ed230d93e85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/666edd3825ba4e32ac180ed230d93e85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/666edd3825ba4e32ac180ed230d93e85"}]}] Jun 30 18:41:44.870167 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant: tempest-TestMinimumBasicScenario-1969508574 Jun 30 18:41:44.870167 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Id: 666edd3825ba4e32ac180ed230d93e85 Jun 30 18:41:44.870167 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1969508574 Jun 30 18:41:44.870167 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User: tempest-TestMinimumBasicScenario-1969508574-project Jun 30 18:41:44.870167 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Id: default Jun 30 18:41:44.870167 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Name: Default Jun 30 18:41:44.870167 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Id: 784fdfd56b3d4ae4b6f68b66c4f06ea5 Jun 30 18:41:44.870167 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Name: tempest-TestMinimumBasicScenario-1969508574-project Jun 30 18:41:44.870167 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: method: > Jun 30 18:41:44.870167 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: exception: Instance c4a22a51-62b8-4ad0-88e4-f959b6cc606f is not attached to volume dc0e93d6-bc1e-4978-9c43-1511667bb441 Jun 30 18:41:44.870980 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: action_args: {'server_id': 'c4a22a51-62b8-4ad0-88e4-f959b6cc606f', 'id': 'dc0e93d6-bc1e-4978-9c43-1511667bb441'} Jun 30 18:41:44.870980 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:41:44.870980 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:41:44.870980 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 30 18:41:44.870980 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 30 18:41:44.870980 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 18:41:44.870980 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 18:41:44.870980 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 30 18:41:44.870980 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 30 18:41:44.870980 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id dc0e93d6-bc1e-4978-9c43-1511667bb441. Jun 30 18:41:44.870980 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:41:44.870980 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:41:44.870980 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:41:44.870980 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:41:44.870980 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:41:44.870980 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:41:44.870980 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:41:44.870980 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:41:44.870980 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:41:44.872271 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:41:44.872271 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 30 18:41:44.872271 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 30 18:41:44.872271 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4a22a51-62b8-4ad0-88e4-f959b6cc606f is not attached to volume dc0e93d6-bc1e-4978-9c43-1511667bb441 Jun 30 18:41:44.872271 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:41:44.872271 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:41:44.872271 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:41:44.872271 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:41:44.872271 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:41:44.872271 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:41:44.872271 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:41:44.872271 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:41:44.872271 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4a22a51-62b8-4ad0-88e4-f959b6cc606f is not attached to volume dc0e93d6-bc1e-4978-9c43-1511667bb441 Jun 30 18:41:44.872271 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:41:44.872271 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-54ee8f3e-2063-4b1f-8719-622a119d7c61 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Returning 404 to user: Instance c4a22a51-62b8-4ad0-88e4-f959b6cc606f is not attached to volume dc0e93d6-bc1e-4978-9c43-1511667bb441 {{(pid=117941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:41:44.873276 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-54ee8f3e-2063-4b1f-8719-622a119d7c61 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f/os-volume_attachments/dc0e93d6-bc1e-4978-9c43-1511667bb441" status: 404 len: 154 microversion: 2.1 time: 0.100198 Jun 30 18:41:44.873276 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 561/1112] 10.222.0.33 () {58 vars in 1415 bytes} [Thu Jun 30 18:41:44 2022] DELETE /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f/os-volume_attachments/dc0e93d6-bc1e-4978-9c43-1511667bb441 => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 30 18:41:45.439406 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-4f7a9d93-1313-49dd-b6db-abb92bef1de5 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Flavor limits 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 18:41:45.439830 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-4f7a9d93-1313-49dd-b6db-abb92bef1de5 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Image limits 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 18:41:45.440306 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-4f7a9d93-1313-49dd-b6db-abb92bef1de5 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Flavor pref 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 18:41:45.440714 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-4f7a9d93-1313-49dd-b6db-abb92bef1de5 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Image pref 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 18:41:45.441125 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-4f7a9d93-1313-49dd-b6db-abb92bef1de5 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 18:41:45.449901 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-4f7a9d93-1313-49dd-b6db-abb92bef1de5 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:45.450371 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-4f7a9d93-1313-49dd-b6db-abb92bef1de5 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:45.451141 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-4f7a9d93-1313-49dd-b6db-abb92bef1de5 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:45.451583 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-4f7a9d93-1313-49dd-b6db-abb92bef1de5 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:45.468039 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.quota [None req-4f7a9d93-1313-49dd-b6db-abb92bef1de5 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Getting quotas for project b8227be3d9a044ed888b2f54abd9463d. Resources: {'ram', 'instances', 'cores'} {{(pid=117940) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 18:41:45.471952 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.quota [None req-4f7a9d93-1313-49dd-b6db-abb92bef1de5 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Getting quotas for user 9531d18446eb4488bbd1511cb3412925 and project b8227be3d9a044ed888b2f54abd9463d. Resources: {'ram', 'instances', 'cores'} {{(pid=117940) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 18:41:45.483443 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-4f7a9d93-1313-49dd-b6db-abb92bef1de5 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Going to run 1 instances... {{(pid=117940) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 18:41:45.485693 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-4f7a9d93-1313-49dd-b6db-abb92bef1de5 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 4281e4fd-b31a-4efd-9d86-15c070b7895e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='636d6d52-5033-47e1-bf75-0b4fc50c0bb0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117940) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 18:41:45.532193 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-4f7a9d93-1313-49dd-b6db-abb92bef1de5 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.833994 Jun 30 18:41:45.532824 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 552/1113] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 30 18:41:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 18:41:45.543975 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-c7aaa79d-66ab-4ece-b82f-3e3301a92cb9 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:41:45.544583 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-c7aaa79d-66ab-4ece-b82f-3e3301a92cb9 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 4281e4fd-b31a-4efd-9d86-15c070b7895e] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:41:45.605051 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-c7aaa79d-66ab-4ece-b82f-3e3301a92cb9 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:41:45.612591 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-c7aaa79d-66ab-4ece-b82f-3e3301a92cb9 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/4281e4fd-b31a-4efd-9d86-15c070b7895e" status: 200 len: 1242 microversion: 2.1 time: 0.072558 Jun 30 18:41:45.613140 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 562/1114] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:41:45 2022] GET /compute/v2.1/servers/4281e4fd-b31a-4efd-9d86-15c070b7895e => generated 1242 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:41:46.006448 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-4d6fad38-a01a-4232-9388-32a095325355 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:41:46.007090 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-4d6fad38-a01a-4232-9388-32a095325355 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:41:46.013883 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-4d6fad38-a01a-4232-9388-32a095325355 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:46.014322 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-4d6fad38-a01a-4232-9388-32a095325355 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:46.015072 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-4d6fad38-a01a-4232-9388-32a095325355 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:46.015497 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-4d6fad38-a01a-4232-9388-32a095325355 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:46.043528 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-4d6fad38-a01a-4232-9388-32a095325355 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Going to try to terminate instance {{(pid=117940) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 18:41:46.123619 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-4d6fad38-a01a-4232-9388-32a095325355 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 204 len: 0 microversion: 2.1 time: 0.121754 Jun 30 18:41:46.124127 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 553/1115] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 30 18:41:46 2022] DELETE /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 18:41:46.132486 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-9bb9a08f-1f8f-4816-964d-68de084dc7f9 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:41:46.133104 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-9bb9a08f-1f8f-4816-964d-68de084dc7f9 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:41:46.139622 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9bb9a08f-1f8f-4816-964d-68de084dc7f9 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:46.140071 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9bb9a08f-1f8f-4816-964d-68de084dc7f9 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:46.140861 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9bb9a08f-1f8f-4816-964d-68de084dc7f9 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:46.141296 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9bb9a08f-1f8f-4816-964d-68de084dc7f9 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:46.268240 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-9bb9a08f-1f8f-4816-964d-68de084dc7f9 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784fdfd56b3d4ae4b6f68b66c4f06ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666edd3825ba4e32ac180ed230d93e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:41:46.276271 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-9bb9a08f-1f8f-4816-964d-68de084dc7f9 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 200 len: 1554 microversion: 2.1 time: 0.147889 Jun 30 18:41:46.276826 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 563/1116] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:41:46 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:41:46.632528 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-d40d3f7a-d434-42ef-8763-7b997bb71cdc tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:41:46.633229 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-d40d3f7a-d434-42ef-8763-7b997bb71cdc tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 4281e4fd-b31a-4efd-9d86-15c070b7895e] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:41:46.639635 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d40d3f7a-d434-42ef-8763-7b997bb71cdc tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:46.640081 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d40d3f7a-d434-42ef-8763-7b997bb71cdc tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:46.640843 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d40d3f7a-d434-42ef-8763-7b997bb71cdc tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:46.641282 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-d40d3f7a-d434-42ef-8763-7b997bb71cdc tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:46.708226 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-d40d3f7a-d434-42ef-8763-7b997bb71cdc tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:41:46.717073 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-d40d3f7a-d434-42ef-8763-7b997bb71cdc tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/4281e4fd-b31a-4efd-9d86-15c070b7895e" status: 200 len: 1294 microversion: 2.1 time: 0.091254 Jun 30 18:41:46.718009 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 554/1117] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:41:46 2022] GET /compute/v2.1/servers/4281e4fd-b31a-4efd-9d86-15c070b7895e => generated 1294 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:41:47.293214 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-d939b9f6-fff1-4d10-9997-ffc1c50f96bb tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:41:47.293768 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-d939b9f6-fff1-4d10-9997-ffc1c50f96bb tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:41:47.300292 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d939b9f6-fff1-4d10-9997-ffc1c50f96bb tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:47.300740 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d939b9f6-fff1-4d10-9997-ffc1c50f96bb tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:47.301491 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d939b9f6-fff1-4d10-9997-ffc1c50f96bb tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:47.301953 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-d939b9f6-fff1-4d10-9997-ffc1c50f96bb tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:47.436324 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-d939b9f6-fff1-4d10-9997-ffc1c50f96bb tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784fdfd56b3d4ae4b6f68b66c4f06ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666edd3825ba4e32ac180ed230d93e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:41:47.444155 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-d939b9f6-fff1-4d10-9997-ffc1c50f96bb tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 200 len: 1554 microversion: 2.1 time: 0.154953 Jun 30 18:41:47.444724 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 564/1118] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:41:47 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:41:47.736166 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-31539575-66d2-4341-b3e3-4fbcae3dab36 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:41:47.736802 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-31539575-66d2-4341-b3e3-4fbcae3dab36 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 4281e4fd-b31a-4efd-9d86-15c070b7895e] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:41:47.743923 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-31539575-66d2-4341-b3e3-4fbcae3dab36 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:47.744374 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-31539575-66d2-4341-b3e3-4fbcae3dab36 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:47.745139 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-31539575-66d2-4341-b3e3-4fbcae3dab36 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:47.745605 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-31539575-66d2-4341-b3e3-4fbcae3dab36 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:47.807329 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-31539575-66d2-4341-b3e3-4fbcae3dab36 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:41:47.814768 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-31539575-66d2-4341-b3e3-4fbcae3dab36 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/4281e4fd-b31a-4efd-9d86-15c070b7895e" status: 200 len: 1294 microversion: 2.1 time: 0.082493 Jun 30 18:41:47.815335 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 555/1119] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:41:47 2022] GET /compute/v2.1/servers/4281e4fd-b31a-4efd-9d86-15c070b7895e => generated 1294 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:41:48.460453 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-c256fba8-a07c-4ae0-ad1c-642a8c916985 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:41:48.461074 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-c256fba8-a07c-4ae0-ad1c-642a8c916985 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:41:48.467489 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c256fba8-a07c-4ae0-ad1c-642a8c916985 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:48.467927 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c256fba8-a07c-4ae0-ad1c-642a8c916985 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:48.468680 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c256fba8-a07c-4ae0-ad1c-642a8c916985 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:48.469109 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c256fba8-a07c-4ae0-ad1c-642a8c916985 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:48.672609 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-c256fba8-a07c-4ae0-ad1c-642a8c916985 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784fdfd56b3d4ae4b6f68b66c4f06ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666edd3825ba4e32ac180ed230d93e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:41:48.681823 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-c256fba8-a07c-4ae0-ad1c-642a8c916985 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 200 len: 1554 microversion: 2.1 time: 0.225152 Jun 30 18:41:48.691270 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 565/1120] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:41:48 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 1554 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:41:48.831814 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-5c99cf2a-f6a6-4518-a5bf-35809c6459b5 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:41:48.832417 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-5c99cf2a-f6a6-4518-a5bf-35809c6459b5 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 4281e4fd-b31a-4efd-9d86-15c070b7895e] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:41:48.839636 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5c99cf2a-f6a6-4518-a5bf-35809c6459b5 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:48.840076 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5c99cf2a-f6a6-4518-a5bf-35809c6459b5 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:48.840834 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5c99cf2a-f6a6-4518-a5bf-35809c6459b5 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:48.841259 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5c99cf2a-f6a6-4518-a5bf-35809c6459b5 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:48.944236 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-5c99cf2a-f6a6-4518-a5bf-35809c6459b5 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:41:48.952023 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-5c99cf2a-f6a6-4518-a5bf-35809c6459b5 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/4281e4fd-b31a-4efd-9d86-15c070b7895e" status: 200 len: 1300 microversion: 2.1 time: 0.123953 Jun 30 18:41:48.952958 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 556/1121] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:41:48 2022] GET /compute/v2.1/servers/4281e4fd-b31a-4efd-9d86-15c070b7895e => generated 1300 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:41:49.054246 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-e9a627c8-87a4-49f4-b35b-9efbf5c8f459 req-93607213-21ac-41f3-b903-f2037abfd70a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4a22a51-62b8-4ad0-88e4-f959b6cc606f", "name": "network-vif-deleted", "tag": "66b87a68-1890-42c6-b759-72e44f506ff1"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:41:49.065735 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-e9a627c8-87a4-49f4-b35b-9efbf5c8f459 req-93607213-21ac-41f3-b903-f2037abfd70a service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:49.066418 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-e9a627c8-87a4-49f4-b35b-9efbf5c8f459 req-93607213-21ac-41f3-b903-f2037abfd70a service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:49.086945 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.compute.server_external_events [req-e9a627c8-87a4-49f4-b35b-9efbf5c8f459 req-93607213-21ac-41f3-b903-f2037abfd70a service nova] Creating event network-vif-deleted:66b87a68-1890-42c6-b759-72e44f506ff1 for instance c4a22a51-62b8-4ad0-88e4-f959b6cc606f on hv-cinder-80378 Jun 30 18:41:49.093589 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-e9a627c8-87a4-49f4-b35b-9efbf5c8f459 req-93607213-21ac-41f3-b903-f2037abfd70a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044962 Jun 30 18:41:49.094294 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 566/1122] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:41:49.699894 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-908f60cb-8623-4e6a-b0c3-3f3716293a9b tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:41:49.700703 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-908f60cb-8623-4e6a-b0c3-3f3716293a9b tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:41:49.708035 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-908f60cb-8623-4e6a-b0c3-3f3716293a9b tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:49.709058 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-908f60cb-8623-4e6a-b0c3-3f3716293a9b tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:49.710112 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-908f60cb-8623-4e6a-b0c3-3f3716293a9b tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:49.710645 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-908f60cb-8623-4e6a-b0c3-3f3716293a9b tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:49.746232 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-908f60cb-8623-4e6a-b0c3-3f3716293a9b tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:49.746786 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-908f60cb-8623-4e6a-b0c3-3f3716293a9b tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:49.747237 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.objects.instance [None req-908f60cb-8623-4e6a-b0c3-3f3716293a9b tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lazy-loading 'fault' on Instance uuid c4a22a51-62b8-4ad0-88e4-f959b6cc606f {{(pid=117940) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 18:41:49.827267 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-908f60cb-8623-4e6a-b0c3-3f3716293a9b tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784fdfd56b3d4ae4b6f68b66c4f06ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666edd3825ba4e32ac180ed230d93e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:41:49.834468 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-908f60cb-8623-4e6a-b0c3-3f3716293a9b tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 200 len: 1348 microversion: 2.1 time: 0.138646 Jun 30 18:41:49.835097 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 557/1123] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:41:49 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 1348 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:41:49.971978 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-68b58662-89bb-4e27-8726-f31f2a441275 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:41:49.972806 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-68b58662-89bb-4e27-8726-f31f2a441275 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 4281e4fd-b31a-4efd-9d86-15c070b7895e] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:41:49.980635 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-68b58662-89bb-4e27-8726-f31f2a441275 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:49.981091 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-68b58662-89bb-4e27-8726-f31f2a441275 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:49.981897 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-68b58662-89bb-4e27-8726-f31f2a441275 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:49.982332 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-68b58662-89bb-4e27-8726-f31f2a441275 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:50.195541 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-68b58662-89bb-4e27-8726-f31f2a441275 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:41:50.202910 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-68b58662-89bb-4e27-8726-f31f2a441275 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/4281e4fd-b31a-4efd-9d86-15c070b7895e" status: 200 len: 1367 microversion: 2.1 time: 0.235576 Jun 30 18:41:50.212552 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 567/1124] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:41:49 2022] GET /compute/v2.1/servers/4281e4fd-b31a-4efd-9d86-15c070b7895e => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:41:50.346317 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [req-14789a30-2d07-4de8-9b90-9fad55e7b226 req-dfb816e8-9f6a-4586-9ef1-833d461e09f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4281e4fd-b31a-4efd-9d86-15c070b7895e", "tag": "9a744f53-9af2-4037-a700-c94f628f6144"}]} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:41:50.361383 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-14789a30-2d07-4de8-9b90-9fad55e7b226 req-dfb816e8-9f6a-4586-9ef1-833d461e09f8 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:50.362048 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-14789a30-2d07-4de8-9b90-9fad55e7b226 req-dfb816e8-9f6a-4586-9ef1-833d461e09f8 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:50.374801 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.compute.server_external_events [req-14789a30-2d07-4de8-9b90-9fad55e7b226 req-dfb816e8-9f6a-4586-9ef1-833d461e09f8 service nova] Creating event network-changed:9a744f53-9af2-4037-a700-c94f628f6144 for instance 4281e4fd-b31a-4efd-9d86-15c070b7895e on hv-cinder-80378 Jun 30 18:41:50.379422 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [req-14789a30-2d07-4de8-9b90-9fad55e7b226 req-dfb816e8-9f6a-4586-9ef1-833d461e09f8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036928 Jun 30 18:41:50.380186 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 558/1125] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:41:50.852138 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-70f889f2-b00b-4040-ab07-fdbb0bef25b5 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:41:50.852694 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-70f889f2-b00b-4040-ab07-fdbb0bef25b5 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] [instance: c4a22a51-62b8-4ad0-88e4-f959b6cc606f] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:41:50.858598 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-70f889f2-b00b-4040-ab07-fdbb0bef25b5 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:50.859039 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-70f889f2-b00b-4040-ab07-fdbb0bef25b5 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:50.859781 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-70f889f2-b00b-4040-ab07-fdbb0bef25b5 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:50.860204 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-70f889f2-b00b-4040-ab07-fdbb0bef25b5 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:50.874303 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.wsgi [None req-70f889f2-b00b-4040-ab07-fdbb0bef25b5 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] HTTP exception thrown: Instance c4a22a51-62b8-4ad0-88e4-f959b6cc606f could not be found. Jun 30 18:41:50.875975 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-70f889f2-b00b-4040-ab07-fdbb0bef25b5 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Request method failure captured: Jun 30 18:41:50.875975 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: request: GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f HTTP/1.1 Jun 30 18:41:50.875975 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept: application/json Jun 30 18:41:50.875975 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept-Encoding: identity Jun 30 18:41:50.875975 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Connection: close Jun 30 18:41:50.875975 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Length: 0 Jun 30 18:41:50.875975 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Type: application/json Jun 30 18:41:50.875975 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Host: 10.222.0.33 Jun 30 18:41:50.875975 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Openstack-System-Scope: None Jun 30 18:41:50.875975 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: User-Agent: python-urllib3/1.26.9 Jun 30 18:41:50.875975 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Auth-Token: gAAAAABive1-2Bmt6ede_eIoqwT8NKAvBAl7tSWbmUU2eUAc8Z0Bim6WKX8jiM-Sqp3hD74CZbL5uu_eQXJqNJ4w1moDKJ9SRbQZ85nY1GYiKRaloferwIAkZwHd-Mp7b1uLc3JczQdUhuJm86ps0sLeWPrmu3_lcIDmAgTNcO5qjwvIslrP-Zg Jun 30 18:41:50.875975 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Id: None Jun 30 18:41:50.875975 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Name: None Jun 30 18:41:50.875975 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Identity-Status: Confirmed Jun 30 18:41:50.875975 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Is-Admin-Project: True Jun 30 18:41:50.875975 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Id: default Jun 30 18:41:50.875975 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Name: Default Jun 30 18:41:50.875975 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Id: 666edd3825ba4e32ac180ed230d93e85 Jun 30 18:41:50.875975 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Name: tempest-TestMinimumBasicScenario-1969508574 Jun 30 18:41:50.875975 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Role: reader,member Jun 30 18:41:50.875975 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Roles: reader,member Jun 30 18:41:50.877638 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/666edd3825ba4e32ac180ed230d93e85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_666edd3825ba4e32ac180ed230d93e85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/666edd3825ba4e32ac180ed230d93e85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/666edd3825ba4e32ac180ed230d93e85"}]}] Jun 30 18:41:50.877638 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant: tempest-TestMinimumBasicScenario-1969508574 Jun 30 18:41:50.877638 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Id: 666edd3825ba4e32ac180ed230d93e85 Jun 30 18:41:50.877638 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1969508574 Jun 30 18:41:50.877638 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User: tempest-TestMinimumBasicScenario-1969508574-project Jun 30 18:41:50.877638 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Id: default Jun 30 18:41:50.877638 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Name: Default Jun 30 18:41:50.877638 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Id: 784fdfd56b3d4ae4b6f68b66c4f06ea5 Jun 30 18:41:50.877638 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Name: tempest-TestMinimumBasicScenario-1969508574-project Jun 30 18:41:50.877638 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: method: > Jun 30 18:41:50.877638 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: exception: Instance c4a22a51-62b8-4ad0-88e4-f959b6cc606f could not be found. Jun 30 18:41:50.877638 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: action_args: {'id': 'c4a22a51-62b8-4ad0-88e4-f959b6cc606f'} Jun 30 18:41:50.878677 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:41:50.878677 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:41:50.878677 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:41:50.878677 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:41:50.878677 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:41:50.878677 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:41:50.878677 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:41:50.878677 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:41:50.878677 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:41:50.878677 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:41:50.878677 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4a22a51-62b8-4ad0-88e4-f959b6cc606f could not be found. Jun 30 18:41:50.878677 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:41:50.878677 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:41:50.878677 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:41:50.878677 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:41:50.878677 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:41:50.878677 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:41:50.878677 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:41:50.878677 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:41:50.878677 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:41:50.880240 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:41:50.880240 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:41:50.880240 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:41:50.880240 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:41:50.880240 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:41:50.880240 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:41:50.880240 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:41:50.880240 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4a22a51-62b8-4ad0-88e4-f959b6cc606f could not be found. Jun 30 18:41:50.880240 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:41:50.880240 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:41:50.880240 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:41:50.880240 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:41:50.880240 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:41:50.880240 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:41:50.880240 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:41:50.880240 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:41:50.880240 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4a22a51-62b8-4ad0-88e4-f959b6cc606f could not be found. Jun 30 18:41:50.880240 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:41:50.881885 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-70f889f2-b00b-4040-ab07-fdbb0bef25b5 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Returning 404 to user: Instance c4a22a51-62b8-4ad0-88e4-f959b6cc606f could not be found. {{(pid=117941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:41:50.881885 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-70f889f2-b00b-4040-ab07-fdbb0bef25b5 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f" status: 404 len: 111 microversion: 2.1 time: 0.029803 Jun 30 18:41:50.881885 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 568/1126] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:41:50 2022] GET /compute/v2.1/servers/c4a22a51-62b8-4ad0-88e4-f959b6cc606f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:41:50.887211 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-36d8947c-2ed8-4fb0-975a-12da9ad4c114 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] Calling method '.version_select at 0x7f180592fc10>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:41:50.905068 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-36d8947c-2ed8-4fb0-975a-12da9ad4c114 tempest-TestMinimumBasicScenario-1969508574 tempest-TestMinimumBasicScenario-1969508574-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1711441821" status: 202 len: 0 microversion: 2.1 time: 0.022020 Jun 30 18:41:50.905649 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 559/1127] 10.222.0.33 () {58 vars in 1271 bytes} [Thu Jun 30 18:41:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1711441821 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 18:41:51.219903 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-e9c9b3ce-d6f2-4bac-9888-4300fcfeee48 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:41:51.220521 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-e9c9b3ce-d6f2-4bac-9888-4300fcfeee48 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 4281e4fd-b31a-4efd-9d86-15c070b7895e] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:41:51.227894 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e9c9b3ce-d6f2-4bac-9888-4300fcfeee48 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:51.228409 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e9c9b3ce-d6f2-4bac-9888-4300fcfeee48 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:51.229182 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e9c9b3ce-d6f2-4bac-9888-4300fcfeee48 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:51.229787 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e9c9b3ce-d6f2-4bac-9888-4300fcfeee48 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:51.372738 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-e9c9b3ce-d6f2-4bac-9888-4300fcfeee48 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:41:51.380728 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-e9c9b3ce-d6f2-4bac-9888-4300fcfeee48 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/4281e4fd-b31a-4efd-9d86-15c070b7895e" status: 200 len: 1367 microversion: 2.1 time: 0.164407 Jun 30 18:41:51.381699 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 569/1128] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:41:51 2022] GET /compute/v2.1/servers/4281e4fd-b31a-4efd-9d86-15c070b7895e => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:41:52.399399 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-aaf9a65b-33e8-42c1-8fc1-c26da450d683 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:41:52.400137 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-aaf9a65b-33e8-42c1-8fc1-c26da450d683 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 4281e4fd-b31a-4efd-9d86-15c070b7895e] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:41:52.406224 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-aaf9a65b-33e8-42c1-8fc1-c26da450d683 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:52.406671 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-aaf9a65b-33e8-42c1-8fc1-c26da450d683 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:52.407431 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-aaf9a65b-33e8-42c1-8fc1-c26da450d683 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:52.407866 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-aaf9a65b-33e8-42c1-8fc1-c26da450d683 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:52.544721 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-aaf9a65b-33e8-42c1-8fc1-c26da450d683 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:41:52.552327 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-aaf9a65b-33e8-42c1-8fc1-c26da450d683 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/4281e4fd-b31a-4efd-9d86-15c070b7895e" status: 200 len: 1367 microversion: 2.1 time: 0.157907 Jun 30 18:41:52.552984 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 560/1129] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:41:52 2022] GET /compute/v2.1/servers/4281e4fd-b31a-4efd-9d86-15c070b7895e => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:41:53.572112 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-fe4a3cc8-ed75-47bb-9df5-50e027be7e7a tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:41:53.574877 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-fe4a3cc8-ed75-47bb-9df5-50e027be7e7a tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 4281e4fd-b31a-4efd-9d86-15c070b7895e] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:41:53.584463 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fe4a3cc8-ed75-47bb-9df5-50e027be7e7a tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:53.585158 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fe4a3cc8-ed75-47bb-9df5-50e027be7e7a tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:53.586133 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fe4a3cc8-ed75-47bb-9df5-50e027be7e7a tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:53.586732 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fe4a3cc8-ed75-47bb-9df5-50e027be7e7a tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:53.735296 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-fe4a3cc8-ed75-47bb-9df5-50e027be7e7a tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:41:53.743720 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-fe4a3cc8-ed75-47bb-9df5-50e027be7e7a tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/4281e4fd-b31a-4efd-9d86-15c070b7895e" status: 200 len: 1367 microversion: 2.1 time: 0.177561 Jun 30 18:41:53.744347 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 570/1130] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:41:53 2022] GET /compute/v2.1/servers/4281e4fd-b31a-4efd-9d86-15c070b7895e => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:41:54.763680 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-df925cd0-cf16-457b-94b5-be50d93122ba tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:41:54.765453 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-df925cd0-cf16-457b-94b5-be50d93122ba tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 4281e4fd-b31a-4efd-9d86-15c070b7895e] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:41:54.785573 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-df925cd0-cf16-457b-94b5-be50d93122ba tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:54.786771 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-df925cd0-cf16-457b-94b5-be50d93122ba tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:54.787631 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-df925cd0-cf16-457b-94b5-be50d93122ba tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:54.788326 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-df925cd0-cf16-457b-94b5-be50d93122ba tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:54.963754 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-df925cd0-cf16-457b-94b5-be50d93122ba tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:41:54.971331 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-df925cd0-cf16-457b-94b5-be50d93122ba tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/4281e4fd-b31a-4efd-9d86-15c070b7895e" status: 200 len: 1367 microversion: 2.1 time: 0.213759 Jun 30 18:41:54.971892 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 561/1131] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:41:54 2022] GET /compute/v2.1/servers/4281e4fd-b31a-4efd-9d86-15c070b7895e => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:41:55.988841 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-a88dc491-a0fd-4bfd-bb5b-80ced85506ef tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:41:55.989795 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-a88dc491-a0fd-4bfd-bb5b-80ced85506ef tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 4281e4fd-b31a-4efd-9d86-15c070b7895e] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:41:55.992298 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell0:SELECT=2 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:41:55.998367 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a88dc491-a0fd-4bfd-bb5b-80ced85506ef tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:55.998816 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a88dc491-a0fd-4bfd-bb5b-80ced85506ef tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:55.999622 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a88dc491-a0fd-4bfd-bb5b-80ced85506ef tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:56.000002 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a88dc491-a0fd-4bfd-bb5b-80ced85506ef tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:56.136569 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-a88dc491-a0fd-4bfd-bb5b-80ced85506ef tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:41:56.143985 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-a88dc491-a0fd-4bfd-bb5b-80ced85506ef tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/4281e4fd-b31a-4efd-9d86-15c070b7895e" status: 200 len: 1367 microversion: 2.1 time: 0.159193 Jun 30 18:41:56.144541 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 571/1132] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:41:55 2022] GET /compute/v2.1/servers/4281e4fd-b31a-4efd-9d86-15c070b7895e => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:41:56.699097 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [req-2fcd22ad-1f2b-4a8a-bcb7-dbf71c3d85f9 req-91ccb4ed-3757-4455-a8d3-89cd597e4979 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4281e4fd-b31a-4efd-9d86-15c070b7895e", "name": "network-vif-plugged", "status": "completed", "tag": "9a744f53-9af2-4037-a700-c94f628f6144"}]} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:41:56.706467 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell0:SELECT=2 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:41:56.710075 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell0:SELECT=10 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:41:56.720419 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-2fcd22ad-1f2b-4a8a-bcb7-dbf71c3d85f9 req-91ccb4ed-3757-4455-a8d3-89cd597e4979 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:56.721160 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-2fcd22ad-1f2b-4a8a-bcb7-dbf71c3d85f9 req-91ccb4ed-3757-4455-a8d3-89cd597e4979 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:56.739395 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.compute.server_external_events [req-2fcd22ad-1f2b-4a8a-bcb7-dbf71c3d85f9 req-91ccb4ed-3757-4455-a8d3-89cd597e4979 service nova] Creating event network-vif-plugged:9a744f53-9af2-4037-a700-c94f628f6144 for instance 4281e4fd-b31a-4efd-9d86-15c070b7895e on hv-cinder-80378 Jun 30 18:41:56.745317 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [req-2fcd22ad-1f2b-4a8a-bcb7-dbf71c3d85f9 req-91ccb4ed-3757-4455-a8d3-89cd597e4979 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055013 Jun 30 18:41:56.746749 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 562/1133] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:41:57.162235 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-226876ac-5ff0-420f-83fe-fcf5391e5e1e tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:41:57.162763 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-226876ac-5ff0-420f-83fe-fcf5391e5e1e tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 4281e4fd-b31a-4efd-9d86-15c070b7895e] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:41:57.169332 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-226876ac-5ff0-420f-83fe-fcf5391e5e1e tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:57.169809 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-226876ac-5ff0-420f-83fe-fcf5391e5e1e tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:57.170562 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-226876ac-5ff0-420f-83fe-fcf5391e5e1e tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:57.170990 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-226876ac-5ff0-420f-83fe-fcf5391e5e1e tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:57.318452 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-226876ac-5ff0-420f-83fe-fcf5391e5e1e tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:41:57.329138 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-226876ac-5ff0-420f-83fe-fcf5391e5e1e tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/4281e4fd-b31a-4efd-9d86-15c070b7895e" status: 200 len: 1367 microversion: 2.1 time: 0.171284 Jun 30 18:41:57.330835 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 572/1134] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:41:57 2022] GET /compute/v2.1/servers/4281e4fd-b31a-4efd-9d86-15c070b7895e => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:41:58.347697 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-97c87f8f-6b66-4626-a157-0c27d24a8a35 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:41:58.348941 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-97c87f8f-6b66-4626-a157-0c27d24a8a35 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 4281e4fd-b31a-4efd-9d86-15c070b7895e] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:41:58.355546 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-97c87f8f-6b66-4626-a157-0c27d24a8a35 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:58.356002 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-97c87f8f-6b66-4626-a157-0c27d24a8a35 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:58.356759 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-97c87f8f-6b66-4626-a157-0c27d24a8a35 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:58.357188 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-97c87f8f-6b66-4626-a157-0c27d24a8a35 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:58.529601 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-97c87f8f-6b66-4626-a157-0c27d24a8a35 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:41:58.538792 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-97c87f8f-6b66-4626-a157-0c27d24a8a35 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/4281e4fd-b31a-4efd-9d86-15c070b7895e" status: 200 len: 1367 microversion: 2.1 time: 0.195300 Jun 30 18:41:58.539444 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 563/1135] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:41:58 2022] GET /compute/v2.1/servers/4281e4fd-b31a-4efd-9d86-15c070b7895e => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:41:59.556124 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-470e1a75-ef9f-4e86-baa7-17fb93ff5184 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:41:59.556989 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-470e1a75-ef9f-4e86-baa7-17fb93ff5184 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 4281e4fd-b31a-4efd-9d86-15c070b7895e] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:41:59.563191 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-470e1a75-ef9f-4e86-baa7-17fb93ff5184 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:59.563637 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-470e1a75-ef9f-4e86-baa7-17fb93ff5184 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:59.564408 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-470e1a75-ef9f-4e86-baa7-17fb93ff5184 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:59.564869 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-470e1a75-ef9f-4e86-baa7-17fb93ff5184 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:59.585645 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:41:59.713078 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-470e1a75-ef9f-4e86-baa7-17fb93ff5184 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:41:59.720546 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-470e1a75-ef9f-4e86-baa7-17fb93ff5184 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/4281e4fd-b31a-4efd-9d86-15c070b7895e" status: 200 len: 1556 microversion: 2.1 time: 0.169276 Jun 30 18:41:59.721110 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 573/1136] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:41:59 2022] GET /compute/v2.1/servers/4281e4fd-b31a-4efd-9d86-15c070b7895e => generated 1556 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:41:59.737182 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-599050b2-b0b0-4457-838f-8012c2e65702 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:41:59.738313 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-599050b2-b0b0-4457-838f-8012c2e65702 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 4281e4fd-b31a-4efd-9d86-15c070b7895e] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:41:59.744665 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-599050b2-b0b0-4457-838f-8012c2e65702 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:59.745113 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-599050b2-b0b0-4457-838f-8012c2e65702 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:59.745897 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-599050b2-b0b0-4457-838f-8012c2e65702 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:41:59.746328 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-599050b2-b0b0-4457-838f-8012c2e65702 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:41:59.825053 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-599050b2-b0b0-4457-838f-8012c2e65702 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/4281e4fd-b31a-4efd-9d86-15c070b7895e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091584 Jun 30 18:41:59.825925 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 564/1137] 10.222.0.33 () {58 vars in 1274 bytes} [Thu Jun 30 18:41:59 2022] GET /compute/v2.1/servers/4281e4fd-b31a-4efd-9d86-15c070b7895e/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:42:01.109112 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-36ffe5db-6372-4c3d-985a-f371775b0b9e req-7b9ca122-d774-4bee-a636-507e632252aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4281e4fd-b31a-4efd-9d86-15c070b7895e", "tag": "9a744f53-9af2-4037-a700-c94f628f6144"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:42:01.121411 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-36ffe5db-6372-4c3d-985a-f371775b0b9e req-7b9ca122-d774-4bee-a636-507e632252aa service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:01.121978 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-36ffe5db-6372-4c3d-985a-f371775b0b9e req-7b9ca122-d774-4bee-a636-507e632252aa service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:01.134226 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.compute.server_external_events [req-36ffe5db-6372-4c3d-985a-f371775b0b9e req-7b9ca122-d774-4bee-a636-507e632252aa service nova] Creating event network-changed:9a744f53-9af2-4037-a700-c94f628f6144 for instance 4281e4fd-b31a-4efd-9d86-15c070b7895e on hv-cinder-80378 Jun 30 18:42:01.139768 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-36ffe5db-6372-4c3d-985a-f371775b0b9e req-7b9ca122-d774-4bee-a636-507e632252aa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037098 Jun 30 18:42:01.140443 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 574/1138] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:42:09.181887 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-6d66d94a-1f2e-409a-99e8-5dd62bcd9066 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Action: 'create', calling method: .version_select at 0x7f1804cbb160>, body: {"keypair": {"name": "tempest-TestShelveInstance-1513175658", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAF9M3AjTr4GVuebhluPnbY5puQFzYaie6JnNk06ytSU2oi9J7HvKOWsPP6mauqCYXX4umca1JpYl+YQzLr+c51wtP/1O18D9w5K/vaRFDSDrDTA3CphOfOMM4N/VXgX7w=="}} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:42:09.188815 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:42:09.200827 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.quota [None req-6d66d94a-1f2e-409a-99e8-5dd62bcd9066 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Getting quotas for project 8bc355242c9d490d91fbcbd7d08f8b97. Resources: {'key_pairs'} {{(pid=117940) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 18:42:09.206287 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.quota [None req-6d66d94a-1f2e-409a-99e8-5dd62bcd9066 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Getting quotas for user f7f4e45a0882410088464b550a4b06c1 and project 8bc355242c9d490d91fbcbd7d08f8b97. Resources: {'key_pairs'} {{(pid=117940) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 18:42:09.231747 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-6d66d94a-1f2e-409a-99e8-5dd62bcd9066 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.256888 Jun 30 18:42:09.232360 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 565/1139] 10.222.0.33 () {60 vars in 1158 bytes} [Thu Jun 30 18:42:08 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:42:32.790967 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_api:SELECT=44 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:42:32.791698 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell1:SELECT=4 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:42:32.795805 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-1a1627fd-972e-40ce-9f14-93133309c5e9 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2089175217", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1513175658", "security_groups": [{"name": "tempest-secgroup-smoke-564240564"}], "networks": [{"uuid": "fd25873d-da02-4e03-a70c-602cfaf0cf21"}], "block_device_mapping_v2": [{"uuid": "0c1be377-0af3-485d-aa4f-16b73a0a95e0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:42:32.906585 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.network.neutron [None req-1a1627fd-972e-40ce-9f14-93133309c5e9 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] validate_networks() for [('fd25873d-da02-4e03-a70c-602cfaf0cf21', None, None, None, None, None)] {{(pid=117941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 18:42:33.378663 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.virt.hardware [None req-1a1627fd-972e-40ce-9f14-93133309c5e9 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Flavor limits 0:0:0 {{(pid=117941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 18:42:33.379080 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.virt.hardware [None req-1a1627fd-972e-40ce-9f14-93133309c5e9 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Image limits 0:0:0 {{(pid=117941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 18:42:33.379545 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.virt.hardware [None req-1a1627fd-972e-40ce-9f14-93133309c5e9 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Flavor pref 0:0:0 {{(pid=117941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 18:42:33.379946 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.virt.hardware [None req-1a1627fd-972e-40ce-9f14-93133309c5e9 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Image pref 0:0:0 {{(pid=117941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 18:42:33.380350 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.virt.hardware [None req-1a1627fd-972e-40ce-9f14-93133309c5e9 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 18:42:33.389788 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1a1627fd-972e-40ce-9f14-93133309c5e9 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:33.394302 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1a1627fd-972e-40ce-9f14-93133309c5e9 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:33.395119 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1a1627fd-972e-40ce-9f14-93133309c5e9 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:33.395552 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1a1627fd-972e-40ce-9f14-93133309c5e9 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:33.412194 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.quota [None req-1a1627fd-972e-40ce-9f14-93133309c5e9 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Getting quotas for project 8bc355242c9d490d91fbcbd7d08f8b97. Resources: {'ram', 'instances', 'cores'} {{(pid=117941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 18:42:33.416142 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.quota [None req-1a1627fd-972e-40ce-9f14-93133309c5e9 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Getting quotas for user f7f4e45a0882410088464b550a4b06c1 and project 8bc355242c9d490d91fbcbd7d08f8b97. Resources: {'ram', 'instances', 'cores'} {{(pid=117941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 18:42:33.477605 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-1a1627fd-972e-40ce-9f14-93133309c5e9 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Going to run 1 instances... {{(pid=117941) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 18:42:33.479811 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-1a1627fd-972e-40ce-9f14-93133309c5e9 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0c1be377-0af3-485d-aa4f-16b73a0a95e0',volume_size=None,volume_type=None)] {{(pid=117941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 18:42:33.607648 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-1a1627fd-972e-40ce-9f14-93133309c5e9 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.818294 Jun 30 18:42:33.608291 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 575/1140] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 30 18:42:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 18:42:33.619303 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-9a59a6fe-7d0a-4994-8e37-a16da0e982f9 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:42:33.619933 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-9a59a6fe-7d0a-4994-8e37-a16da0e982f9 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:42:33.622028 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:42:33.622854 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell0:SELECT=4 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:42:33.623532 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_api:SELECT=10,nova_api:INSERT=1 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:42:33.682959 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-9a59a6fe-7d0a-4994-8e37-a16da0e982f9 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f4e45a0882410088464b550a4b06c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc355242c9d490d91fbcbd7d08f8b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:42:33.690290 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-9a59a6fe-7d0a-4994-8e37-a16da0e982f9 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177" status: 200 len: 1089 microversion: 2.1 time: 0.074888 Jun 30 18:42:33.690891 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 566/1141] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:42:33 2022] GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177 => generated 1089 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:42:34.710693 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-f5e02977-5f65-4e42-af6a-0265b9cebe64 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:42:34.711305 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-f5e02977-5f65-4e42-af6a-0265b9cebe64 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:42:34.718299 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f5e02977-5f65-4e42-af6a-0265b9cebe64 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:34.718755 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f5e02977-5f65-4e42-af6a-0265b9cebe64 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:34.719556 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f5e02977-5f65-4e42-af6a-0265b9cebe64 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:34.720100 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f5e02977-5f65-4e42-af6a-0265b9cebe64 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:34.789314 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-f5e02977-5f65-4e42-af6a-0265b9cebe64 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f4e45a0882410088464b550a4b06c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc355242c9d490d91fbcbd7d08f8b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:42:34.797293 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-f5e02977-5f65-4e42-af6a-0265b9cebe64 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177" status: 200 len: 1187 microversion: 2.1 time: 0.091154 Jun 30 18:42:34.798384 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 576/1142] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:42:34 2022] GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177 => generated 1187 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:42:35.816862 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-e9f8bcaa-0a90-4ce7-b206-43f7861f1dc5 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:42:35.817422 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-e9f8bcaa-0a90-4ce7-b206-43f7861f1dc5 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:42:35.824214 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e9f8bcaa-0a90-4ce7-b206-43f7861f1dc5 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:35.824648 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e9f8bcaa-0a90-4ce7-b206-43f7861f1dc5 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:35.825416 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e9f8bcaa-0a90-4ce7-b206-43f7861f1dc5 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:35.825864 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e9f8bcaa-0a90-4ce7-b206-43f7861f1dc5 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:36.151545 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-e9f8bcaa-0a90-4ce7-b206-43f7861f1dc5 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f4e45a0882410088464b550a4b06c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc355242c9d490d91fbcbd7d08f8b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:42:36.159448 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-e9f8bcaa-0a90-4ce7-b206-43f7861f1dc5 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177" status: 200 len: 1260 microversion: 2.1 time: 0.347495 Jun 30 18:42:36.160100 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 567/1143] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:42:35 2022] GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177 => generated 1260 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:42:36.557081 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-bf4fe8a2-66a2-4acb-9a60-20a0c0b9b498 req-5279114f-1b0b-4797-948d-56a4c78cb5ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e521acf7-4c22-4f2f-9014-0fe2b98e5177", "tag": "2f35c8e5-f600-4e52-a4cb-3e624aeebaff"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:42:36.571492 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-bf4fe8a2-66a2-4acb-9a60-20a0c0b9b498 req-5279114f-1b0b-4797-948d-56a4c78cb5ed service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:36.572024 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-bf4fe8a2-66a2-4acb-9a60-20a0c0b9b498 req-5279114f-1b0b-4797-948d-56a4c78cb5ed service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:36.585479 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.compute.server_external_events [req-bf4fe8a2-66a2-4acb-9a60-20a0c0b9b498 req-5279114f-1b0b-4797-948d-56a4c78cb5ed service nova] Creating event network-changed:2f35c8e5-f600-4e52-a4cb-3e624aeebaff for instance e521acf7-4c22-4f2f-9014-0fe2b98e5177 on hv-cinder-80378 Jun 30 18:42:36.590429 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-bf4fe8a2-66a2-4acb-9a60-20a0c0b9b498 req-5279114f-1b0b-4797-948d-56a4c78cb5ed service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039637 Jun 30 18:42:36.592074 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 577/1144] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:42:37.176801 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-fead77a0-dcf5-4b00-bd33-c47206833462 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:42:37.177443 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-fead77a0-dcf5-4b00-bd33-c47206833462 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:42:37.185047 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fead77a0-dcf5-4b00-bd33-c47206833462 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:37.185502 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fead77a0-dcf5-4b00-bd33-c47206833462 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:37.186556 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fead77a0-dcf5-4b00-bd33-c47206833462 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:37.186995 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fead77a0-dcf5-4b00-bd33-c47206833462 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:37.334755 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-fead77a0-dcf5-4b00-bd33-c47206833462 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f4e45a0882410088464b550a4b06c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc355242c9d490d91fbcbd7d08f8b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:42:37.342779 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-fead77a0-dcf5-4b00-bd33-c47206833462 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177" status: 200 len: 1260 microversion: 2.1 time: 0.170090 Jun 30 18:42:37.343472 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 568/1145] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:42:37 2022] GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:42:37.799865 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-aee75f4c-2552-4a8e-9edf-368430940b82 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:42:37.800452 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-aee75f4c-2552-4a8e-9edf-368430940b82 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: ddef212b-cb7c-4978-ab68-1e9db1ea5246] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:42:37.807179 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-aee75f4c-2552-4a8e-9edf-368430940b82 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:37.807621 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-aee75f4c-2552-4a8e-9edf-368430940b82 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:37.808272 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [req-542bf8de-7928-4bd0-93e9-f87a64528e24 req-98a79982-8efc-4904-8137-ff828b327cd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddef212b-cb7c-4978-ab68-1e9db1ea5246", "tag": "9c6eff65-98fe-438e-96c1-652f799ad853"}]} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:42:37.808446 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-aee75f4c-2552-4a8e-9edf-368430940b82 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:37.808808 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-aee75f4c-2552-4a8e-9edf-368430940b82 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:37.817391 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-542bf8de-7928-4bd0-93e9-f87a64528e24 req-98a79982-8efc-4904-8137-ff828b327cd7 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:37.817923 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-542bf8de-7928-4bd0-93e9-f87a64528e24 req-98a79982-8efc-4904-8137-ff828b327cd7 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:37.828874 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.compute.server_external_events [req-542bf8de-7928-4bd0-93e9-f87a64528e24 req-98a79982-8efc-4904-8137-ff828b327cd7 service nova] Creating event network-changed:9c6eff65-98fe-438e-96c1-652f799ad853 for instance ddef212b-cb7c-4978-ab68-1e9db1ea5246 on hv-cinder-80378 Jun 30 18:42:37.834208 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [req-542bf8de-7928-4bd0-93e9-f87a64528e24 req-98a79982-8efc-4904-8137-ff828b327cd7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029481 Jun 30 18:42:37.835132 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 569/1146] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:42:37.837040 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-aee75f4c-2552-4a8e-9edf-368430940b82 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: ddef212b-cb7c-4978-ab68-1e9db1ea5246] Going to try to terminate instance {{(pid=117941) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 18:42:37.914493 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-aee75f4c-2552-4a8e-9edf-368430940b82 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ddef212b-cb7c-4978-ab68-1e9db1ea5246" status: 204 len: 0 microversion: 2.1 time: 0.119942 Jun 30 18:42:37.918172 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 578/1147] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 30 18:42:37 2022] DELETE /compute/v2.1/servers/ddef212b-cb7c-4978-ab68-1e9db1ea5246 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 18:42:37.923791 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-6ed5d9d4-b8db-44f7-b59a-fd07d1da2fdf tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:42:37.924489 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-6ed5d9d4-b8db-44f7-b59a-fd07d1da2fdf tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: ddef212b-cb7c-4978-ab68-1e9db1ea5246] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:42:37.931910 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6ed5d9d4-b8db-44f7-b59a-fd07d1da2fdf tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:37.932548 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6ed5d9d4-b8db-44f7-b59a-fd07d1da2fdf tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:37.934277 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6ed5d9d4-b8db-44f7-b59a-fd07d1da2fdf tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:37.934727 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6ed5d9d4-b8db-44f7-b59a-fd07d1da2fdf tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:38.098897 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-6ed5d9d4-b8db-44f7-b59a-fd07d1da2fdf tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:42:38.106488 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-6ed5d9d4-b8db-44f7-b59a-fd07d1da2fdf tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/ddef212b-cb7c-4978-ab68-1e9db1ea5246" status: 200 len: 1576 microversion: 2.1 time: 0.186936 Jun 30 18:42:38.107151 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 570/1148] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:42:37 2022] GET /compute/v2.1/servers/ddef212b-cb7c-4978-ab68-1e9db1ea5246 => generated 1576 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:42:38.360951 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-2121fc90-6e70-4ab6-8ca6-e74eac8ae96d tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:42:38.361675 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-2121fc90-6e70-4ab6-8ca6-e74eac8ae96d tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:42:38.367706 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2121fc90-6e70-4ab6-8ca6-e74eac8ae96d tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:38.368153 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2121fc90-6e70-4ab6-8ca6-e74eac8ae96d tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:38.368908 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2121fc90-6e70-4ab6-8ca6-e74eac8ae96d tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:38.369338 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-2121fc90-6e70-4ab6-8ca6-e74eac8ae96d tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:38.509085 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-2121fc90-6e70-4ab6-8ca6-e74eac8ae96d tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f4e45a0882410088464b550a4b06c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc355242c9d490d91fbcbd7d08f8b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:42:38.517530 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-2121fc90-6e70-4ab6-8ca6-e74eac8ae96d tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177" status: 200 len: 1260 microversion: 2.1 time: 0.161627 Jun 30 18:42:38.518136 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 579/1149] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:42:38 2022] GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:42:39.126774 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-c6e24be7-e372-414a-9145-cd3d97aa6f05 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:42:39.128209 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-c6e24be7-e372-414a-9145-cd3d97aa6f05 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: ddef212b-cb7c-4978-ab68-1e9db1ea5246] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:42:39.137719 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c6e24be7-e372-414a-9145-cd3d97aa6f05 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:39.138468 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c6e24be7-e372-414a-9145-cd3d97aa6f05 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:39.139497 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c6e24be7-e372-414a-9145-cd3d97aa6f05 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:39.140139 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c6e24be7-e372-414a-9145-cd3d97aa6f05 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:39.331168 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-c6e24be7-e372-414a-9145-cd3d97aa6f05 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:42:39.338544 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-c6e24be7-e372-414a-9145-cd3d97aa6f05 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/ddef212b-cb7c-4978-ab68-1e9db1ea5246" status: 200 len: 1576 microversion: 2.1 time: 0.216654 Jun 30 18:42:39.339099 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 571/1150] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:42:39 2022] GET /compute/v2.1/servers/ddef212b-cb7c-4978-ab68-1e9db1ea5246 => generated 1576 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:42:39.534632 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-896d5587-440c-4023-828c-a6be4b93a59b tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:42:39.535159 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-896d5587-440c-4023-828c-a6be4b93a59b tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:42:39.543983 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-896d5587-440c-4023-828c-a6be4b93a59b tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:39.544763 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-896d5587-440c-4023-828c-a6be4b93a59b tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:39.546123 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-896d5587-440c-4023-828c-a6be4b93a59b tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:39.547064 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-896d5587-440c-4023-828c-a6be4b93a59b tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:39.685841 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-896d5587-440c-4023-828c-a6be4b93a59b tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f4e45a0882410088464b550a4b06c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc355242c9d490d91fbcbd7d08f8b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:42:39.693375 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-896d5587-440c-4023-828c-a6be4b93a59b tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177" status: 200 len: 1260 microversion: 2.1 time: 0.163121 Jun 30 18:42:39.694156 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 580/1151] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:42:39 2022] GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:42:40.357106 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-0af2fe1c-961a-4c40-978a-9f693694b7d1 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:42:40.357762 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-0af2fe1c-961a-4c40-978a-9f693694b7d1 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: ddef212b-cb7c-4978-ab68-1e9db1ea5246] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:42:40.364304 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0af2fe1c-961a-4c40-978a-9f693694b7d1 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:40.364747 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0af2fe1c-961a-4c40-978a-9f693694b7d1 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:40.365628 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0af2fe1c-961a-4c40-978a-9f693694b7d1 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:40.365959 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0af2fe1c-961a-4c40-978a-9f693694b7d1 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:40.460582 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-0af2fe1c-961a-4c40-978a-9f693694b7d1 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:42:40.468564 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-0af2fe1c-961a-4c40-978a-9f693694b7d1 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/ddef212b-cb7c-4978-ab68-1e9db1ea5246" status: 200 len: 1389 microversion: 2.1 time: 0.116323 Jun 30 18:42:40.469810 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 572/1152] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:42:40 2022] GET /compute/v2.1/servers/ddef212b-cb7c-4978-ab68-1e9db1ea5246 => generated 1389 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:42:40.513247 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-fe27f1ea-fc4b-48bf-9856-d728c61b9648 req-19e93ece-f0ad-49ad-b1d9-e82c42c3146f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddef212b-cb7c-4978-ab68-1e9db1ea5246", "name": "network-vif-deleted", "tag": "9c6eff65-98fe-438e-96c1-652f799ad853"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:42:40.522892 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-fe27f1ea-fc4b-48bf-9856-d728c61b9648 req-19e93ece-f0ad-49ad-b1d9-e82c42c3146f service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:40.523325 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-fe27f1ea-fc4b-48bf-9856-d728c61b9648 req-19e93ece-f0ad-49ad-b1d9-e82c42c3146f service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:40.534928 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.compute.server_external_events [req-fe27f1ea-fc4b-48bf-9856-d728c61b9648 req-19e93ece-f0ad-49ad-b1d9-e82c42c3146f service nova] Creating event network-vif-deleted:9c6eff65-98fe-438e-96c1-652f799ad853 for instance ddef212b-cb7c-4978-ab68-1e9db1ea5246 on hv-cinder-80378 Jun 30 18:42:40.540519 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-fe27f1ea-fc4b-48bf-9856-d728c61b9648 req-19e93ece-f0ad-49ad-b1d9-e82c42c3146f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030805 Jun 30 18:42:40.541181 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 581/1153] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:42:40.710791 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-f3fd0885-60d4-413e-b44e-966bd0592726 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:42:40.711469 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-f3fd0885-60d4-413e-b44e-966bd0592726 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:42:40.717689 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f3fd0885-60d4-413e-b44e-966bd0592726 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:40.718231 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f3fd0885-60d4-413e-b44e-966bd0592726 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:40.719703 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f3fd0885-60d4-413e-b44e-966bd0592726 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:40.720163 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f3fd0885-60d4-413e-b44e-966bd0592726 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:40.858817 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-f3fd0885-60d4-413e-b44e-966bd0592726 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f4e45a0882410088464b550a4b06c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc355242c9d490d91fbcbd7d08f8b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:42:40.866728 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-f3fd0885-60d4-413e-b44e-966bd0592726 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177" status: 200 len: 1260 microversion: 2.1 time: 0.160021 Jun 30 18:42:40.867505 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 573/1154] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:42:40 2022] GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:42:41.487111 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-c0f77696-d2b7-4abd-b7b8-ff21147e3d5c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:42:41.487799 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-c0f77696-d2b7-4abd-b7b8-ff21147e3d5c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: ddef212b-cb7c-4978-ab68-1e9db1ea5246] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:42:41.494064 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c0f77696-d2b7-4abd-b7b8-ff21147e3d5c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:41.494507 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c0f77696-d2b7-4abd-b7b8-ff21147e3d5c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:41.495255 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c0f77696-d2b7-4abd-b7b8-ff21147e3d5c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:41.495681 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c0f77696-d2b7-4abd-b7b8-ff21147e3d5c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:41.525877 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c0f77696-d2b7-4abd-b7b8-ff21147e3d5c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:41.526313 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c0f77696-d2b7-4abd-b7b8-ff21147e3d5c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:41.526752 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.objects.instance [None req-c0f77696-d2b7-4abd-b7b8-ff21147e3d5c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lazy-loading 'fault' on Instance uuid ddef212b-cb7c-4978-ab68-1e9db1ea5246 {{(pid=117941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 18:42:41.575277 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-c0f77696-d2b7-4abd-b7b8-ff21147e3d5c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:42:41.585160 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-c0f77696-d2b7-4abd-b7b8-ff21147e3d5c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/ddef212b-cb7c-4978-ab68-1e9db1ea5246" status: 200 len: 1229 microversion: 2.1 time: 0.102624 Jun 30 18:42:41.585796 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 582/1155] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:42:41 2022] GET /compute/v2.1/servers/ddef212b-cb7c-4978-ab68-1e9db1ea5246 => generated 1229 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:42:41.883904 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-2a5718f7-c817-4fca-a742-4d0e796309ed tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:42:41.884431 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-2a5718f7-c817-4fca-a742-4d0e796309ed tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:42:41.891944 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-2a5718f7-c817-4fca-a742-4d0e796309ed tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:41.892396 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-2a5718f7-c817-4fca-a742-4d0e796309ed tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:41.893151 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-2a5718f7-c817-4fca-a742-4d0e796309ed tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:41.893599 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-2a5718f7-c817-4fca-a742-4d0e796309ed tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:42.023327 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-2a5718f7-c817-4fca-a742-4d0e796309ed tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f4e45a0882410088464b550a4b06c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc355242c9d490d91fbcbd7d08f8b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:42:42.030689 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-2a5718f7-c817-4fca-a742-4d0e796309ed tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177" status: 200 len: 1260 microversion: 2.1 time: 0.150745 Jun 30 18:42:42.031323 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 574/1156] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:42:41 2022] GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:42:42.603435 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-1f6cb5ac-4c15-4337-943d-161eb8c6a975 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:42:42.604013 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-1f6cb5ac-4c15-4337-943d-161eb8c6a975 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: ddef212b-cb7c-4978-ab68-1e9db1ea5246] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:42:42.611172 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1f6cb5ac-4c15-4337-943d-161eb8c6a975 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:42.611605 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1f6cb5ac-4c15-4337-943d-161eb8c6a975 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:42.612349 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1f6cb5ac-4c15-4337-943d-161eb8c6a975 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:42.612775 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1f6cb5ac-4c15-4337-943d-161eb8c6a975 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:42.626237 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.wsgi [None req-1f6cb5ac-4c15-4337-943d-161eb8c6a975 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] HTTP exception thrown: Instance ddef212b-cb7c-4978-ab68-1e9db1ea5246 could not be found. Jun 30 18:42:42.627890 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-1f6cb5ac-4c15-4337-943d-161eb8c6a975 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Request method failure captured: Jun 30 18:42:42.627890 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: request: GET /compute/v2.1/servers/ddef212b-cb7c-4978-ab68-1e9db1ea5246 HTTP/1.1 Jun 30 18:42:42.627890 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept: application/json Jun 30 18:42:42.627890 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept-Encoding: identity Jun 30 18:42:42.627890 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Connection: close Jun 30 18:42:42.627890 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Length: 0 Jun 30 18:42:42.627890 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Type: application/json Jun 30 18:42:42.627890 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Host: 10.222.0.33 Jun 30 18:42:42.627890 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Openstack-System-Scope: None Jun 30 18:42:42.627890 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: User-Agent: python-urllib3/1.26.9 Jun 30 18:42:42.627890 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Auth-Token: gAAAAABiveyK8TH-8E6opIMiZgHOT15c88aE9wFV_DnS2JDw_PHcFiDa0g0Nh0vqnDSVG-tczSdKpb9L9Rpmy1PfEikb75Mg4K5xnk9MGICOlzKjcukAq_wRIHkhnDaevuF741H6YMcoIX-itp6TdgiqJRK5q3wGBAcPdIBfRsu4DwkfWb953Gg Jun 30 18:42:42.627890 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Id: None Jun 30 18:42:42.627890 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Name: None Jun 30 18:42:42.627890 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Identity-Status: Confirmed Jun 30 18:42:42.627890 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Is-Admin-Project: True Jun 30 18:42:42.627890 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Id: default Jun 30 18:42:42.627890 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Name: Default Jun 30 18:42:42.627890 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Id: 64655c9e82bb4515a976f41ac93b242f Jun 30 18:42:42.627890 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Name: tempest-TestVolumeBootPattern-2010085685 Jun 30 18:42:42.627890 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Role: reader,member Jun 30 18:42:42.627890 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Roles: reader,member Jun 30 18:42:42.629621 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/64655c9e82bb4515a976f41ac93b242f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_64655c9e82bb4515a976f41ac93b242f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/64655c9e82bb4515a976f41ac93b242f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/64655c9e82bb4515a976f41ac93b242f"}]}] Jun 30 18:42:42.629621 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant: tempest-TestVolumeBootPattern-2010085685 Jun 30 18:42:42.629621 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Id: 64655c9e82bb4515a976f41ac93b242f Jun 30 18:42:42.629621 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Name: tempest-TestVolumeBootPattern-2010085685 Jun 30 18:42:42.629621 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User: tempest-TestVolumeBootPattern-2010085685-project Jun 30 18:42:42.629621 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Id: default Jun 30 18:42:42.629621 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Name: Default Jun 30 18:42:42.629621 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Id: 31c0594d0be84154a601d625bca699cd Jun 30 18:42:42.629621 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Name: tempest-TestVolumeBootPattern-2010085685-project Jun 30 18:42:42.629621 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: method: > Jun 30 18:42:42.629621 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: exception: Instance ddef212b-cb7c-4978-ab68-1e9db1ea5246 could not be found. Jun 30 18:42:42.629621 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: action_args: {'id': 'ddef212b-cb7c-4978-ab68-1e9db1ea5246'} Jun 30 18:42:42.630601 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:42:42.630601 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:42:42.630601 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:42:42.630601 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:42:42.630601 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:42:42.630601 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:42:42.630601 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:42:42.630601 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:42:42.630601 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:42:42.630601 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:42:42.630601 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddef212b-cb7c-4978-ab68-1e9db1ea5246 could not be found. Jun 30 18:42:42.630601 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:42:42.630601 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:42:42.630601 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:42:42.630601 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:42:42.630601 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:42:42.630601 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:42:42.630601 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:42:42.630601 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:42:42.630601 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:42:42.632420 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:42:42.632420 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:42:42.632420 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:42:42.632420 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:42:42.632420 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:42:42.632420 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:42:42.632420 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:42:42.632420 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddef212b-cb7c-4978-ab68-1e9db1ea5246 could not be found. Jun 30 18:42:42.632420 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:42:42.632420 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:42:42.632420 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:42:42.632420 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:42:42.632420 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:42:42.632420 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:42:42.632420 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:42:42.632420 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:42:42.632420 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddef212b-cb7c-4978-ab68-1e9db1ea5246 could not be found. Jun 30 18:42:42.632420 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:42:42.633992 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-1f6cb5ac-4c15-4337-943d-161eb8c6a975 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Returning 404 to user: Instance ddef212b-cb7c-4978-ab68-1e9db1ea5246 could not be found. {{(pid=117941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:42:42.633992 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-1f6cb5ac-4c15-4337-943d-161eb8c6a975 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/ddef212b-cb7c-4978-ab68-1e9db1ea5246" status: 404 len: 111 microversion: 2.1 time: 0.029775 Jun 30 18:42:42.633992 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 583/1157] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:42:42 2022] GET /compute/v2.1/servers/ddef212b-cb7c-4978-ab68-1e9db1ea5246 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:42:43.047315 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-6e417acf-0554-47cf-ad4d-83487e9edc5a tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:42:43.048012 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-6e417acf-0554-47cf-ad4d-83487e9edc5a tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:42:43.054656 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6e417acf-0554-47cf-ad4d-83487e9edc5a tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:43.055106 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6e417acf-0554-47cf-ad4d-83487e9edc5a tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:43.055863 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6e417acf-0554-47cf-ad4d-83487e9edc5a tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:43.056299 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-6e417acf-0554-47cf-ad4d-83487e9edc5a tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:43.189690 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-6e417acf-0554-47cf-ad4d-83487e9edc5a tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f4e45a0882410088464b550a4b06c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc355242c9d490d91fbcbd7d08f8b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:42:43.198084 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-6e417acf-0554-47cf-ad4d-83487e9edc5a tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177" status: 200 len: 1260 microversion: 2.1 time: 0.154608 Jun 30 18:42:43.198652 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 575/1158] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:42:43 2022] GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:42:44.214521 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-6ad88006-5051-4106-97e4-1b2015375e31 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:42:44.215118 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-6ad88006-5051-4106-97e4-1b2015375e31 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:42:44.217026 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell0:SELECT=2 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:42:44.217717 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell0:SELECT=6 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:42:44.224207 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6ad88006-5051-4106-97e4-1b2015375e31 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:44.224645 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6ad88006-5051-4106-97e4-1b2015375e31 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:44.225382 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6ad88006-5051-4106-97e4-1b2015375e31 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:44.225830 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6ad88006-5051-4106-97e4-1b2015375e31 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:44.361113 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-6ad88006-5051-4106-97e4-1b2015375e31 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f4e45a0882410088464b550a4b06c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc355242c9d490d91fbcbd7d08f8b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:42:44.368473 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-6ad88006-5051-4106-97e4-1b2015375e31 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177" status: 200 len: 1260 microversion: 2.1 time: 0.157793 Jun 30 18:42:44.369035 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 584/1159] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:42:44 2022] GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:42:45.387373 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-262b95b6-ed9a-4d5c-bd6e-1095ffe65cd4 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:42:45.387985 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-262b95b6-ed9a-4d5c-bd6e-1095ffe65cd4 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:42:45.390001 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell0:SELECT=2 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:42:45.396519 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-262b95b6-ed9a-4d5c-bd6e-1095ffe65cd4 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:45.396965 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-262b95b6-ed9a-4d5c-bd6e-1095ffe65cd4 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:45.397754 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-262b95b6-ed9a-4d5c-bd6e-1095ffe65cd4 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:45.398182 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-262b95b6-ed9a-4d5c-bd6e-1095ffe65cd4 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:45.529252 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-262b95b6-ed9a-4d5c-bd6e-1095ffe65cd4 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f4e45a0882410088464b550a4b06c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc355242c9d490d91fbcbd7d08f8b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:42:45.537423 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-262b95b6-ed9a-4d5c-bd6e-1095ffe65cd4 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177" status: 200 len: 1260 microversion: 2.1 time: 0.153977 Jun 30 18:42:45.538033 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 576/1160] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:42:45 2022] GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:42:45.714626 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-1241abd8-4102-44e7-8fef-24b6e1c7fa49 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:42:45.715258 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-1241abd8-4102-44e7-8fef-24b6e1c7fa49 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: d718c533-1949-4ce7-a767-bdc51f16293a] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:42:45.716732 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [req-618e7807-8f04-4887-8a17-3db0a8acb892 req-07fd14de-1041-4082-922b-e9e083649105 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d718c533-1949-4ce7-a767-bdc51f16293a", "tag": "ba3cd163-a8e4-46d4-ab5e-d19b0f7bd916"}]} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:42:45.721818 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1241abd8-4102-44e7-8fef-24b6e1c7fa49 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:45.722259 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1241abd8-4102-44e7-8fef-24b6e1c7fa49 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:45.723011 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1241abd8-4102-44e7-8fef-24b6e1c7fa49 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:45.723431 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-1241abd8-4102-44e7-8fef-24b6e1c7fa49 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:45.725275 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-618e7807-8f04-4887-8a17-3db0a8acb892 req-07fd14de-1041-4082-922b-e9e083649105 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:45.725811 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-618e7807-8f04-4887-8a17-3db0a8acb892 req-07fd14de-1041-4082-922b-e9e083649105 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:45.736791 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.compute.server_external_events [req-618e7807-8f04-4887-8a17-3db0a8acb892 req-07fd14de-1041-4082-922b-e9e083649105 service nova] Creating event network-changed:ba3cd163-a8e4-46d4-ab5e-d19b0f7bd916 for instance d718c533-1949-4ce7-a767-bdc51f16293a on hv-cinder-80378 Jun 30 18:42:45.742037 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [req-618e7807-8f04-4887-8a17-3db0a8acb892 req-07fd14de-1041-4082-922b-e9e083649105 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029078 Jun 30 18:42:45.742733 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 577/1161] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:42:45.750625 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-1241abd8-4102-44e7-8fef-24b6e1c7fa49 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: d718c533-1949-4ce7-a767-bdc51f16293a] Going to try to terminate instance {{(pid=117941) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 18:42:45.834938 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-1241abd8-4102-44e7-8fef-24b6e1c7fa49 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a" status: 204 len: 0 microversion: 2.1 time: 0.124015 Jun 30 18:42:45.837017 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 585/1162] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 30 18:42:45 2022] DELETE /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 18:42:45.846559 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-9662d7c7-90a2-42e8-a6f7-5afef0c8b9aa tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:42:45.847266 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-9662d7c7-90a2-42e8-a6f7-5afef0c8b9aa tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: d718c533-1949-4ce7-a767-bdc51f16293a] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:42:45.853498 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9662d7c7-90a2-42e8-a6f7-5afef0c8b9aa tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:45.853997 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9662d7c7-90a2-42e8-a6f7-5afef0c8b9aa tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:45.854755 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9662d7c7-90a2-42e8-a6f7-5afef0c8b9aa tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:45.855182 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9662d7c7-90a2-42e8-a6f7-5afef0c8b9aa tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:45.995168 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-9662d7c7-90a2-42e8-a6f7-5afef0c8b9aa tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:42:46.003860 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-9662d7c7-90a2-42e8-a6f7-5afef0c8b9aa tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a" status: 200 len: 1576 microversion: 2.1 time: 0.162446 Jun 30 18:42:46.004650 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 578/1163] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:42:45 2022] GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:42:46.555124 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-c18c08c6-f8a7-4e3e-ba3a-c2d27b98b282 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:42:46.555900 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-c18c08c6-f8a7-4e3e-ba3a-c2d27b98b282 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:42:46.562667 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c18c08c6-f8a7-4e3e-ba3a-c2d27b98b282 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:46.563347 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c18c08c6-f8a7-4e3e-ba3a-c2d27b98b282 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:46.564413 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c18c08c6-f8a7-4e3e-ba3a-c2d27b98b282 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:46.565007 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c18c08c6-f8a7-4e3e-ba3a-c2d27b98b282 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:46.712474 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-c18c08c6-f8a7-4e3e-ba3a-c2d27b98b282 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f4e45a0882410088464b550a4b06c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc355242c9d490d91fbcbd7d08f8b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:42:46.721205 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-c18c08c6-f8a7-4e3e-ba3a-c2d27b98b282 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177" status: 200 len: 1260 microversion: 2.1 time: 0.170536 Jun 30 18:42:46.721930 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 586/1164] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:42:46 2022] GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:42:47.021386 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-984afea8-6c8d-45e0-92f2-cb48b2d0eb1a tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:42:47.022687 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-984afea8-6c8d-45e0-92f2-cb48b2d0eb1a tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: d718c533-1949-4ce7-a767-bdc51f16293a] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:42:47.030192 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-984afea8-6c8d-45e0-92f2-cb48b2d0eb1a tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:47.030870 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-984afea8-6c8d-45e0-92f2-cb48b2d0eb1a tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:47.032710 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-984afea8-6c8d-45e0-92f2-cb48b2d0eb1a tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:47.033209 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-984afea8-6c8d-45e0-92f2-cb48b2d0eb1a tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:47.226191 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-984afea8-6c8d-45e0-92f2-cb48b2d0eb1a tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c0594d0be84154a601d625bca699cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64655c9e82bb4515a976f41ac93b242f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:42:47.234528 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-984afea8-6c8d-45e0-92f2-cb48b2d0eb1a tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a" status: 200 len: 1458 microversion: 2.1 time: 0.216268 Jun 30 18:42:47.237048 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 579/1165] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:42:47 2022] GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a => generated 1458 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:42:47.338738 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-8daaae08-aa55-4dd1-933e-2c1c07b1f0a8 req-44de9478-fe83-4398-82a9-e68e2195b48f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d718c533-1949-4ce7-a767-bdc51f16293a", "name": "network-vif-deleted", "tag": "ba3cd163-a8e4-46d4-ab5e-d19b0f7bd916"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:42:47.348018 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-8daaae08-aa55-4dd1-933e-2c1c07b1f0a8 req-44de9478-fe83-4398-82a9-e68e2195b48f service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:47.348378 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-8daaae08-aa55-4dd1-933e-2c1c07b1f0a8 req-44de9478-fe83-4398-82a9-e68e2195b48f service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:47.360041 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.compute.server_external_events [req-8daaae08-aa55-4dd1-933e-2c1c07b1f0a8 req-44de9478-fe83-4398-82a9-e68e2195b48f service nova] Creating event network-vif-deleted:ba3cd163-a8e4-46d4-ab5e-d19b0f7bd916 for instance d718c533-1949-4ce7-a767-bdc51f16293a on hv-cinder-80378 Jun 30 18:42:47.366956 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-8daaae08-aa55-4dd1-933e-2c1c07b1f0a8 req-44de9478-fe83-4398-82a9-e68e2195b48f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031834 Jun 30 18:42:47.367619 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 587/1166] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:42:47.738529 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-96f2f253-a4c8-4a1e-9a18-535bfbeed226 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:42:47.739446 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-96f2f253-a4c8-4a1e-9a18-535bfbeed226 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:42:47.745568 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-96f2f253-a4c8-4a1e-9a18-535bfbeed226 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:47.746381 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-96f2f253-a4c8-4a1e-9a18-535bfbeed226 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:47.747340 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-96f2f253-a4c8-4a1e-9a18-535bfbeed226 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:47.747772 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-96f2f253-a4c8-4a1e-9a18-535bfbeed226 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:47.895362 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-96f2f253-a4c8-4a1e-9a18-535bfbeed226 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f4e45a0882410088464b550a4b06c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc355242c9d490d91fbcbd7d08f8b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:42:47.902844 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-96f2f253-a4c8-4a1e-9a18-535bfbeed226 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177" status: 200 len: 1260 microversion: 2.1 time: 0.168796 Jun 30 18:42:47.903409 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 580/1167] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:42:47 2022] GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177 => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:42:48.260322 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-42fc45be-3245-4fa0-b16a-61ff42c0126c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:42:48.261020 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-42fc45be-3245-4fa0-b16a-61ff42c0126c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: d718c533-1949-4ce7-a767-bdc51f16293a] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:42:48.267359 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-42fc45be-3245-4fa0-b16a-61ff42c0126c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:48.267806 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-42fc45be-3245-4fa0-b16a-61ff42c0126c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:48.268560 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-42fc45be-3245-4fa0-b16a-61ff42c0126c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:48.269031 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-42fc45be-3245-4fa0-b16a-61ff42c0126c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:48.282088 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.wsgi [None req-42fc45be-3245-4fa0-b16a-61ff42c0126c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] HTTP exception thrown: Instance d718c533-1949-4ce7-a767-bdc51f16293a could not be found. Jun 30 18:42:48.283757 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-42fc45be-3245-4fa0-b16a-61ff42c0126c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Request method failure captured: Jun 30 18:42:48.283757 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: request: GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a HTTP/1.1 Jun 30 18:42:48.283757 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept: application/json Jun 30 18:42:48.283757 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept-Encoding: identity Jun 30 18:42:48.283757 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Connection: close Jun 30 18:42:48.283757 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Length: 0 Jun 30 18:42:48.283757 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Type: application/json Jun 30 18:42:48.283757 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Host: 10.222.0.33 Jun 30 18:42:48.283757 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Openstack-System-Scope: None Jun 30 18:42:48.283757 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: User-Agent: python-urllib3/1.26.9 Jun 30 18:42:48.283757 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Auth-Token: gAAAAABiveyK8TH-8E6opIMiZgHOT15c88aE9wFV_DnS2JDw_PHcFiDa0g0Nh0vqnDSVG-tczSdKpb9L9Rpmy1PfEikb75Mg4K5xnk9MGICOlzKjcukAq_wRIHkhnDaevuF741H6YMcoIX-itp6TdgiqJRK5q3wGBAcPdIBfRsu4DwkfWb953Gg Jun 30 18:42:48.283757 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Id: None Jun 30 18:42:48.283757 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Name: None Jun 30 18:42:48.283757 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Identity-Status: Confirmed Jun 30 18:42:48.283757 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Is-Admin-Project: True Jun 30 18:42:48.283757 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Id: default Jun 30 18:42:48.283757 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Name: Default Jun 30 18:42:48.283757 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Id: 64655c9e82bb4515a976f41ac93b242f Jun 30 18:42:48.283757 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Name: tempest-TestVolumeBootPattern-2010085685 Jun 30 18:42:48.283757 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Role: reader,member Jun 30 18:42:48.283757 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Roles: reader,member Jun 30 18:42:48.285442 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/64655c9e82bb4515a976f41ac93b242f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_64655c9e82bb4515a976f41ac93b242f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/64655c9e82bb4515a976f41ac93b242f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/64655c9e82bb4515a976f41ac93b242f"}]}] Jun 30 18:42:48.285442 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant: tempest-TestVolumeBootPattern-2010085685 Jun 30 18:42:48.285442 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Id: 64655c9e82bb4515a976f41ac93b242f Jun 30 18:42:48.285442 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Name: tempest-TestVolumeBootPattern-2010085685 Jun 30 18:42:48.285442 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User: tempest-TestVolumeBootPattern-2010085685-project Jun 30 18:42:48.285442 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Id: default Jun 30 18:42:48.285442 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Name: Default Jun 30 18:42:48.285442 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Id: 31c0594d0be84154a601d625bca699cd Jun 30 18:42:48.285442 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Name: tempest-TestVolumeBootPattern-2010085685-project Jun 30 18:42:48.285442 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: method: > Jun 30 18:42:48.285442 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: exception: Instance d718c533-1949-4ce7-a767-bdc51f16293a could not be found. Jun 30 18:42:48.285442 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: action_args: {'id': 'd718c533-1949-4ce7-a767-bdc51f16293a'} Jun 30 18:42:48.286331 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:42:48.286331 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:42:48.286331 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:42:48.286331 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:42:48.286331 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:42:48.286331 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:42:48.286331 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:42:48.286331 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:42:48.286331 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:42:48.286331 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:42:48.286331 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d718c533-1949-4ce7-a767-bdc51f16293a could not be found. Jun 30 18:42:48.286331 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:42:48.286331 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:42:48.286331 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:42:48.286331 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:42:48.286331 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:42:48.286331 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:42:48.286331 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:42:48.286331 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:42:48.286331 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:42:48.287613 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:42:48.287613 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:42:48.287613 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:42:48.287613 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:42:48.287613 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:42:48.287613 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:42:48.287613 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:42:48.287613 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d718c533-1949-4ce7-a767-bdc51f16293a could not be found. Jun 30 18:42:48.287613 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:42:48.287613 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:42:48.287613 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:42:48.287613 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:42:48.287613 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:42:48.287613 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:42:48.287613 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:42:48.287613 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:42:48.287613 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d718c533-1949-4ce7-a767-bdc51f16293a could not be found. Jun 30 18:42:48.287613 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:42:48.288764 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-42fc45be-3245-4fa0-b16a-61ff42c0126c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Returning 404 to user: Instance d718c533-1949-4ce7-a767-bdc51f16293a could not be found. {{(pid=117941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:42:48.288764 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-42fc45be-3245-4fa0-b16a-61ff42c0126c tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a" status: 404 len: 111 microversion: 2.1 time: 0.029534 Jun 30 18:42:48.288764 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 588/1168] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:42:48 2022] GET /compute/v2.1/servers/d718c533-1949-4ce7-a767-bdc51f16293a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:42:48.747306 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-bc656112-f0b3-4775-90e0-c253e3199b52 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:42:48.753752 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-bc656112-f0b3-4775-90e0-c253e3199b52 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: 44d46d26-912d-40fd-8bd6-5b576e81cf20] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:42:48.757953 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-bc656112-f0b3-4775-90e0-c253e3199b52 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:48.759134 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-bc656112-f0b3-4775-90e0-c253e3199b52 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:48.760057 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-bc656112-f0b3-4775-90e0-c253e3199b52 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:48.760497 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-bc656112-f0b3-4775-90e0-c253e3199b52 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:48.779127 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.wsgi [None req-bc656112-f0b3-4775-90e0-c253e3199b52 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] HTTP exception thrown: Instance 44d46d26-912d-40fd-8bd6-5b576e81cf20 could not be found. Jun 30 18:42:48.781814 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-bc656112-f0b3-4775-90e0-c253e3199b52 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Request method failure captured: Jun 30 18:42:48.781814 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: request: DELETE /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20 HTTP/1.1 Jun 30 18:42:48.781814 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept: application/json Jun 30 18:42:48.781814 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept-Encoding: identity Jun 30 18:42:48.781814 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Connection: close Jun 30 18:42:48.781814 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Length: 0 Jun 30 18:42:48.781814 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Type: application/json Jun 30 18:42:48.781814 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Host: 10.222.0.33 Jun 30 18:42:48.781814 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Openstack-System-Scope: None Jun 30 18:42:48.781814 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: User-Agent: python-urllib3/1.26.9 Jun 30 18:42:48.781814 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Auth-Token: gAAAAABiveyK8TH-8E6opIMiZgHOT15c88aE9wFV_DnS2JDw_PHcFiDa0g0Nh0vqnDSVG-tczSdKpb9L9Rpmy1PfEikb75Mg4K5xnk9MGICOlzKjcukAq_wRIHkhnDaevuF741H6YMcoIX-itp6TdgiqJRK5q3wGBAcPdIBfRsu4DwkfWb953Gg Jun 30 18:42:48.781814 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Id: None Jun 30 18:42:48.781814 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Name: None Jun 30 18:42:48.781814 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Identity-Status: Confirmed Jun 30 18:42:48.781814 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Is-Admin-Project: True Jun 30 18:42:48.781814 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Id: default Jun 30 18:42:48.781814 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Name: Default Jun 30 18:42:48.781814 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Id: 64655c9e82bb4515a976f41ac93b242f Jun 30 18:42:48.781814 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Name: tempest-TestVolumeBootPattern-2010085685 Jun 30 18:42:48.781814 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Role: reader,member Jun 30 18:42:48.781814 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Roles: reader,member Jun 30 18:42:48.783602 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/64655c9e82bb4515a976f41ac93b242f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_64655c9e82bb4515a976f41ac93b242f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/64655c9e82bb4515a976f41ac93b242f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/64655c9e82bb4515a976f41ac93b242f"}]}] Jun 30 18:42:48.783602 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant: tempest-TestVolumeBootPattern-2010085685 Jun 30 18:42:48.783602 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Id: 64655c9e82bb4515a976f41ac93b242f Jun 30 18:42:48.783602 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Name: tempest-TestVolumeBootPattern-2010085685 Jun 30 18:42:48.783602 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User: tempest-TestVolumeBootPattern-2010085685-project Jun 30 18:42:48.783602 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Id: default Jun 30 18:42:48.783602 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Name: Default Jun 30 18:42:48.783602 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Id: 31c0594d0be84154a601d625bca699cd Jun 30 18:42:48.783602 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Name: tempest-TestVolumeBootPattern-2010085685-project Jun 30 18:42:48.783602 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: method: > Jun 30 18:42:48.783602 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: exception: Instance 44d46d26-912d-40fd-8bd6-5b576e81cf20 could not be found. Jun 30 18:42:48.783602 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: action_args: {'id': '44d46d26-912d-40fd-8bd6-5b576e81cf20'} Jun 30 18:42:48.784763 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:42:48.784763 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:42:48.784763 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:42:48.784763 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:42:48.784763 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:42:48.784763 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:42:48.784763 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:42:48.784763 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:42:48.784763 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:42:48.784763 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:42:48.784763 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44d46d26-912d-40fd-8bd6-5b576e81cf20 could not be found. Jun 30 18:42:48.784763 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:42:48.784763 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:42:48.784763 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:42:48.784763 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:42:48.784763 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:42:48.784763 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:42:48.784763 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:42:48.784763 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:42:48.784763 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:42:48.786577 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:42:48.786577 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 18:42:48.786577 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 18:42:48.786577 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 18:42:48.786577 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 18:42:48.786577 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:42:48.786577 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:42:48.786577 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:42:48.786577 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:42:48.786577 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44d46d26-912d-40fd-8bd6-5b576e81cf20 could not be found. Jun 30 18:42:48.786577 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:42:48.786577 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:42:48.786577 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:42:48.786577 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:42:48.786577 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:42:48.786577 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:42:48.786577 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:42:48.786577 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:42:48.786577 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44d46d26-912d-40fd-8bd6-5b576e81cf20 could not be found. Jun 30 18:42:48.786577 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:42:48.788601 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-bc656112-f0b3-4775-90e0-c253e3199b52 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Returning 404 to user: Instance 44d46d26-912d-40fd-8bd6-5b576e81cf20 could not be found. {{(pid=117940) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:42:48.788601 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-bc656112-f0b3-4775-90e0-c253e3199b52 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "DELETE /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20" status: 404 len: 111 microversion: 2.1 time: 0.039872 Jun 30 18:42:48.788601 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 581/1169] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 30 18:42:48 2022] DELETE /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:42:48.791966 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-7f67e8c7-e8e1-4c2f-bcde-fc25a2e77243 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:42:48.792572 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-7f67e8c7-e8e1-4c2f-bcde-fc25a2e77243 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] [instance: 44d46d26-912d-40fd-8bd6-5b576e81cf20] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:42:48.799158 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7f67e8c7-e8e1-4c2f-bcde-fc25a2e77243 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:48.799607 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7f67e8c7-e8e1-4c2f-bcde-fc25a2e77243 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:48.800364 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7f67e8c7-e8e1-4c2f-bcde-fc25a2e77243 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:48.800793 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7f67e8c7-e8e1-4c2f-bcde-fc25a2e77243 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:48.814188 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.wsgi [None req-7f67e8c7-e8e1-4c2f-bcde-fc25a2e77243 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] HTTP exception thrown: Instance 44d46d26-912d-40fd-8bd6-5b576e81cf20 could not be found. Jun 30 18:42:48.815703 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-7f67e8c7-e8e1-4c2f-bcde-fc25a2e77243 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Request method failure captured: Jun 30 18:42:48.815703 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: request: GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20 HTTP/1.1 Jun 30 18:42:48.815703 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept: application/json Jun 30 18:42:48.815703 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept-Encoding: identity Jun 30 18:42:48.815703 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Connection: close Jun 30 18:42:48.815703 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Length: 0 Jun 30 18:42:48.815703 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Type: application/json Jun 30 18:42:48.815703 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Host: 10.222.0.33 Jun 30 18:42:48.815703 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Openstack-System-Scope: None Jun 30 18:42:48.815703 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: User-Agent: python-urllib3/1.26.9 Jun 30 18:42:48.815703 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Auth-Token: gAAAAABiveyK8TH-8E6opIMiZgHOT15c88aE9wFV_DnS2JDw_PHcFiDa0g0Nh0vqnDSVG-tczSdKpb9L9Rpmy1PfEikb75Mg4K5xnk9MGICOlzKjcukAq_wRIHkhnDaevuF741H6YMcoIX-itp6TdgiqJRK5q3wGBAcPdIBfRsu4DwkfWb953Gg Jun 30 18:42:48.815703 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Id: None Jun 30 18:42:48.815703 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Name: None Jun 30 18:42:48.815703 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Identity-Status: Confirmed Jun 30 18:42:48.815703 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Is-Admin-Project: True Jun 30 18:42:48.815703 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Id: default Jun 30 18:42:48.815703 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Name: Default Jun 30 18:42:48.815703 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Id: 64655c9e82bb4515a976f41ac93b242f Jun 30 18:42:48.815703 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Name: tempest-TestVolumeBootPattern-2010085685 Jun 30 18:42:48.815703 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Role: reader,member Jun 30 18:42:48.815703 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Roles: reader,member Jun 30 18:42:48.817363 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/64655c9e82bb4515a976f41ac93b242f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_64655c9e82bb4515a976f41ac93b242f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/64655c9e82bb4515a976f41ac93b242f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/64655c9e82bb4515a976f41ac93b242f"}]}] Jun 30 18:42:48.817363 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant: tempest-TestVolumeBootPattern-2010085685 Jun 30 18:42:48.817363 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Id: 64655c9e82bb4515a976f41ac93b242f Jun 30 18:42:48.817363 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Name: tempest-TestVolumeBootPattern-2010085685 Jun 30 18:42:48.817363 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User: tempest-TestVolumeBootPattern-2010085685-project Jun 30 18:42:48.817363 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Id: default Jun 30 18:42:48.817363 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Name: Default Jun 30 18:42:48.817363 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Id: 31c0594d0be84154a601d625bca699cd Jun 30 18:42:48.817363 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Name: tempest-TestVolumeBootPattern-2010085685-project Jun 30 18:42:48.817363 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: method: > Jun 30 18:42:48.817363 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: exception: Instance 44d46d26-912d-40fd-8bd6-5b576e81cf20 could not be found. Jun 30 18:42:48.817363 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: action_args: {'id': '44d46d26-912d-40fd-8bd6-5b576e81cf20'} Jun 30 18:42:48.818489 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:42:48.818489 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:42:48.818489 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:42:48.818489 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:42:48.818489 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:42:48.818489 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:42:48.818489 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:42:48.818489 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:42:48.818489 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:42:48.818489 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:42:48.818489 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44d46d26-912d-40fd-8bd6-5b576e81cf20 could not be found. Jun 30 18:42:48.818489 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:42:48.818489 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:42:48.818489 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:42:48.818489 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:42:48.818489 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:42:48.818489 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:42:48.818489 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:42:48.818489 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:42:48.818489 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:42:48.820048 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:42:48.820048 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:42:48.820048 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:42:48.820048 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:42:48.820048 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:42:48.820048 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:42:48.820048 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:42:48.820048 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44d46d26-912d-40fd-8bd6-5b576e81cf20 could not be found. Jun 30 18:42:48.820048 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:42:48.820048 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:42:48.820048 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:42:48.820048 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:42:48.820048 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:42:48.820048 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:42:48.820048 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:42:48.820048 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:42:48.820048 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44d46d26-912d-40fd-8bd6-5b576e81cf20 could not be found. Jun 30 18:42:48.820048 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:42:48.821643 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-7f67e8c7-e8e1-4c2f-bcde-fc25a2e77243 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Returning 404 to user: Instance 44d46d26-912d-40fd-8bd6-5b576e81cf20 could not be found. {{(pid=117941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:42:48.821643 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-7f67e8c7-e8e1-4c2f-bcde-fc25a2e77243 tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20" status: 404 len: 111 microversion: 2.1 time: 0.028879 Jun 30 18:42:48.821643 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 589/1170] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:42:48 2022] GET /compute/v2.1/servers/44d46d26-912d-40fd-8bd6-5b576e81cf20 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:42:48.919643 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-45f74663-ef2a-49c6-b801-3d3dbe41ccbc tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:42:48.920435 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-45f74663-ef2a-49c6-b801-3d3dbe41ccbc tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:42:48.933966 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-45f74663-ef2a-49c6-b801-3d3dbe41ccbc tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:48.934830 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-45f74663-ef2a-49c6-b801-3d3dbe41ccbc tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:48.935770 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-45f74663-ef2a-49c6-b801-3d3dbe41ccbc tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:48.936247 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-45f74663-ef2a-49c6-b801-3d3dbe41ccbc tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:49.005389 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-8409e237-6856-4a96-8617-07986599569f req-c604f333-d5f9-488e-ae82-c20fbb2f091e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e521acf7-4c22-4f2f-9014-0fe2b98e5177", "name": "network-vif-plugged", "status": "completed", "tag": "2f35c8e5-f600-4e52-a4cb-3e624aeebaff"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:42:49.014931 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-8409e237-6856-4a96-8617-07986599569f req-c604f333-d5f9-488e-ae82-c20fbb2f091e service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:49.015511 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-8409e237-6856-4a96-8617-07986599569f req-c604f333-d5f9-488e-ae82-c20fbb2f091e service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:49.032498 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.compute.server_external_events [req-8409e237-6856-4a96-8617-07986599569f req-c604f333-d5f9-488e-ae82-c20fbb2f091e service nova] Creating event network-vif-plugged:2f35c8e5-f600-4e52-a4cb-3e624aeebaff for instance e521acf7-4c22-4f2f-9014-0fe2b98e5177 on hv-cinder-80378 Jun 30 18:42:49.042287 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-8409e237-6856-4a96-8617-07986599569f req-c604f333-d5f9-488e-ae82-c20fbb2f091e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041227 Jun 30 18:42:49.042923 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 590/1171] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:42:49.111284 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-45f74663-ef2a-49c6-b801-3d3dbe41ccbc tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f4e45a0882410088464b550a4b06c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc355242c9d490d91fbcbd7d08f8b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:42:49.119004 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-45f74663-ef2a-49c6-b801-3d3dbe41ccbc tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177" status: 200 len: 1260 microversion: 2.1 time: 0.203374 Jun 30 18:42:49.119748 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 582/1172] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:42:48 2022] GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177 => generated 1260 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:42:50.117414 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-a158a5c4-990f-40e2-82b1-49523dcd81af tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] Calling method '.version_select at 0x7f18050c8e50>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:42:50.137113 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-a158a5c4-990f-40e2-82b1-49523dcd81af tempest-TestVolumeBootPattern-2010085685 tempest-TestVolumeBootPattern-2010085685-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-274103547" status: 202 len: 0 microversion: 2.1 time: 0.024364 Jun 30 18:42:50.140464 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-f7b883ac-c43f-44e9-9084-9e13687f8fc2 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:42:50.141432 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-f7b883ac-c43f-44e9-9084-9e13687f8fc2 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:42:50.147983 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f7b883ac-c43f-44e9-9084-9e13687f8fc2 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:50.148429 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f7b883ac-c43f-44e9-9084-9e13687f8fc2 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:50.149178 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f7b883ac-c43f-44e9-9084-9e13687f8fc2 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:50.149646 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f7b883ac-c43f-44e9-9084-9e13687f8fc2 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:50.150040 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 591/1173] 10.222.0.33 () {58 vars in 1259 bytes} [Thu Jun 30 18:42:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-274103547 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 18:42:50.286377 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-f7b883ac-c43f-44e9-9084-9e13687f8fc2 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f4e45a0882410088464b550a4b06c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc355242c9d490d91fbcbd7d08f8b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:42:50.293735 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-f7b883ac-c43f-44e9-9084-9e13687f8fc2 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177" status: 200 len: 1260 microversion: 2.1 time: 0.159946 Jun 30 18:42:50.294293 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 583/1174] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:42:50 2022] GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:42:51.312207 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-ef15df07-33d1-4e84-891c-a5b3f06e9f72 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:42:51.313019 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-ef15df07-33d1-4e84-891c-a5b3f06e9f72 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:42:51.319855 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ef15df07-33d1-4e84-891c-a5b3f06e9f72 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:51.320376 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ef15df07-33d1-4e84-891c-a5b3f06e9f72 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:51.321214 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ef15df07-33d1-4e84-891c-a5b3f06e9f72 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:51.321767 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ef15df07-33d1-4e84-891c-a5b3f06e9f72 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:51.457455 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-ef15df07-33d1-4e84-891c-a5b3f06e9f72 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f4e45a0882410088464b550a4b06c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc355242c9d490d91fbcbd7d08f8b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:42:51.465146 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-ef15df07-33d1-4e84-891c-a5b3f06e9f72 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177" status: 200 len: 1443 microversion: 2.1 time: 0.158160 Jun 30 18:42:51.465833 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 592/1175] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:42:51 2022] GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177 => generated 1443 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:42:51.481877 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-992e66ea-5a4c-4367-ae35-e2409d1ee9df tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:42:51.482602 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-992e66ea-5a4c-4367-ae35-e2409d1ee9df tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:42:51.489625 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-992e66ea-5a4c-4367-ae35-e2409d1ee9df tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:51.490156 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-992e66ea-5a4c-4367-ae35-e2409d1ee9df tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:51.490978 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-992e66ea-5a4c-4367-ae35-e2409d1ee9df tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:51.491479 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-992e66ea-5a4c-4367-ae35-e2409d1ee9df tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:51.631898 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-992e66ea-5a4c-4367-ae35-e2409d1ee9df tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f4e45a0882410088464b550a4b06c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc355242c9d490d91fbcbd7d08f8b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:42:51.640502 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-992e66ea-5a4c-4367-ae35-e2409d1ee9df tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177" status: 200 len: 1443 microversion: 2.1 time: 0.162351 Jun 30 18:42:51.641147 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 584/1176] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:42:51 2022] GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177 => generated 1443 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:42:53.850853 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-250a94de-b27f-42e5-91e5-8d0d49692e84 req-9dc6048b-ccb8-47e8-a8d2-ca35c69da62c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e521acf7-4c22-4f2f-9014-0fe2b98e5177", "tag": "2f35c8e5-f600-4e52-a4cb-3e624aeebaff"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:42:53.860422 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-250a94de-b27f-42e5-91e5-8d0d49692e84 req-9dc6048b-ccb8-47e8-a8d2-ca35c69da62c service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:42:53.860862 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-250a94de-b27f-42e5-91e5-8d0d49692e84 req-9dc6048b-ccb8-47e8-a8d2-ca35c69da62c service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:42:53.872713 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.compute.server_external_events [req-250a94de-b27f-42e5-91e5-8d0d49692e84 req-9dc6048b-ccb8-47e8-a8d2-ca35c69da62c service nova] Creating event network-changed:2f35c8e5-f600-4e52-a4cb-3e624aeebaff for instance e521acf7-4c22-4f2f-9014-0fe2b98e5177 on hv-cinder-80378 Jun 30 18:42:53.878615 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-250a94de-b27f-42e5-91e5-8d0d49692e84 req-9dc6048b-ccb8-47e8-a8d2-ca35c69da62c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031477 Jun 30 18:42:53.879584 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 593/1177] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:43:17.709200 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-7b690b26-8916-4c90-98c5-f56f6da3550f tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:43:17.709741 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-7b690b26-8916-4c90-98c5-f56f6da3550f tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 4281e4fd-b31a-4efd-9d86-15c070b7895e] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:43:17.711874 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_api:SELECT=40 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:43:17.712536 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell1:SELECT=96 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:43:17.718499 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7b690b26-8916-4c90-98c5-f56f6da3550f tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:17.718944 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7b690b26-8916-4c90-98c5-f56f6da3550f tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:17.719700 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7b690b26-8916-4c90-98c5-f56f6da3550f tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:17.720136 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7b690b26-8916-4c90-98c5-f56f6da3550f tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:17.743079 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-7b690b26-8916-4c90-98c5-f56f6da3550f tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/4281e4fd-b31a-4efd-9d86-15c070b7895e/ips" status: 200 len: 149 microversion: 2.1 time: 0.037856 Jun 30 18:43:17.743649 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 585/1178] 10.222.0.33 () {58 vars in 1247 bytes} [Thu Jun 30 18:43:17 2022] GET /compute/v2.1/servers/4281e4fd-b31a-4efd-9d86-15c070b7895e/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:43:17.755421 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-298981b5-a99e-4d3d-8a8a-c20f6e3e943b tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be142546-76cd-452e-8bef-348e924f5787"}} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:43:17.756646 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-298981b5-a99e-4d3d-8a8a-c20f6e3e943b tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 4281e4fd-b31a-4efd-9d86-15c070b7895e] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:43:17.758979 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:43:17.759624 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:43:17.766897 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-298981b5-a99e-4d3d-8a8a-c20f6e3e943b tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:17.767339 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-298981b5-a99e-4d3d-8a8a-c20f6e3e943b tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:17.768095 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-298981b5-a99e-4d3d-8a8a-c20f6e3e943b tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:17.768522 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-298981b5-a99e-4d3d-8a8a-c20f6e3e943b tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:17.859230 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.wsgi [None req-298981b5-a99e-4d3d-8a8a-c20f6e3e943b tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] HTTP exception thrown: Invalid volume: volume be142546-76cd-452e-8bef-348e924f5787 is already attached to instances: f83962b1-e24e-41ad-969a-b5d8bc609f2c Jun 30 18:43:17.860950 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-298981b5-a99e-4d3d-8a8a-c20f6e3e943b tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Request method failure captured: Jun 30 18:43:17.860950 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: request: POST /compute/v2.1/servers/4281e4fd-b31a-4efd-9d86-15c070b7895e/os-volume_attachments HTTP/1.1 Jun 30 18:43:17.860950 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept: application/json Jun 30 18:43:17.860950 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept-Encoding: identity Jun 30 18:43:17.860950 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Connection: close Jun 30 18:43:17.860950 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Length: 74 Jun 30 18:43:17.860950 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Type: application/json Jun 30 18:43:17.860950 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Host: 10.222.0.33 Jun 30 18:43:17.860950 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Openstack-System-Scope: None Jun 30 18:43:17.860950 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: User-Agent: python-urllib3/1.26.9 Jun 30 18:43:17.860950 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Auth-Token: gAAAAABive3_mQ4kZ2JNveNggCM2j6Qam1PzZzze4niNBx_ABO6k3xVntyI41bCtbU1dqHi3AaxJKokcovO0E907Am7gbM4_Spd2N8jkkVzqboNWXgAyxs4i5CVIc1cpe4RDkM3IBciZBWXtbJ1cU6IuTIKWreKtjsnNHJNRFm0dFUHScNhmgkQ Jun 30 18:43:17.860950 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Id: None Jun 30 18:43:17.860950 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Name: None Jun 30 18:43:17.860950 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Identity-Status: Confirmed Jun 30 18:43:17.860950 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Is-Admin-Project: True Jun 30 18:43:17.860950 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Id: default Jun 30 18:43:17.860950 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Name: Default Jun 30 18:43:17.860950 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Id: b8227be3d9a044ed888b2f54abd9463d Jun 30 18:43:17.860950 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Name: tempest-AttachVolumeNegativeTest-1944998081 Jun 30 18:43:17.860950 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Role: reader,member Jun 30 18:43:17.860950 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Roles: reader,member Jun 30 18:43:17.862767 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b8227be3d9a044ed888b2f54abd9463d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b8227be3d9a044ed888b2f54abd9463d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b8227be3d9a044ed888b2f54abd9463d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b8227be3d9a044ed888b2f54abd9463d"}]}] Jun 30 18:43:17.862767 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant: tempest-AttachVolumeNegativeTest-1944998081 Jun 30 18:43:17.862767 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Id: b8227be3d9a044ed888b2f54abd9463d Jun 30 18:43:17.862767 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1944998081 Jun 30 18:43:17.862767 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User: tempest-AttachVolumeNegativeTest-1944998081-project Jun 30 18:43:17.862767 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Id: default Jun 30 18:43:17.862767 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Name: Default Jun 30 18:43:17.862767 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Id: 9531d18446eb4488bbd1511cb3412925 Jun 30 18:43:17.862767 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Name: tempest-AttachVolumeNegativeTest-1944998081-project Jun 30 18:43:17.862767 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Jun 30 18:43:17.862767 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: {"volumeAttachment": {"volumeId": "be142546-76cd-452e-8bef-348e924f5787"}} Jun 30 18:43:17.862767 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: method: > Jun 30 18:43:17.863842 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: exception: Invalid volume: volume be142546-76cd-452e-8bef-348e924f5787 is already attached to instances: f83962b1-e24e-41ad-969a-b5d8bc609f2c Jun 30 18:43:17.863842 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: action_args: {'server_id': '4281e4fd-b31a-4efd-9d86-15c070b7895e', 'body': {'volumeAttachment': {'volumeId': 'be142546-76cd-452e-8bef-348e924f5787'}}} Jun 30 18:43:17.863842 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:43:17.863842 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:43:17.863842 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 30 18:43:17.863842 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 30 18:43:17.863842 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 30 18:43:17.863842 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 30 18:43:17.863842 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 30 18:43:17.863842 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 30 18:43:17.863842 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 30 18:43:17.863842 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 30 18:43:17.863842 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 30 18:43:17.863842 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 30 18:43:17.863842 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume be142546-76cd-452e-8bef-348e924f5787 is already attached to instances: f83962b1-e24e-41ad-969a-b5d8bc609f2c Jun 30 18:43:17.863842 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:43:17.863842 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:43:17.863842 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:43:17.863842 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:43:17.865465 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:43:17.865465 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:43:17.865465 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:43:17.865465 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:43:17.865465 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:43:17.865465 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:43:17.865465 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 18:43:17.865465 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 18:43:17.865465 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 18:43:17.865465 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 18:43:17.865465 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 18:43:17.865465 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 18:43:17.865465 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 30 18:43:17.865465 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 30 18:43:17.865465 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume be142546-76cd-452e-8bef-348e924f5787 is already attached to instances: f83962b1-e24e-41ad-969a-b5d8bc609f2c Jun 30 18:43:17.865465 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:43:17.865465 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:43:17.865465 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:43:17.865465 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:43:17.865465 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:43:17.867093 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:43:17.867093 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:43:17.867093 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:43:17.867093 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume be142546-76cd-452e-8bef-348e924f5787 is already attached to instances: f83962b1-e24e-41ad-969a-b5d8bc609f2c Jun 30 18:43:17.867093 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:43:17.867093 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-298981b5-a99e-4d3d-8a8a-c20f6e3e943b tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Returning 400 to user: Invalid volume: volume be142546-76cd-452e-8bef-348e924f5787 is already attached to instances: f83962b1-e24e-41ad-969a-b5d8bc609f2c {{(pid=117941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:43:17.867093 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-298981b5-a99e-4d3d-8a8a-c20f6e3e943b tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "POST /compute/v2.1/servers/4281e4fd-b31a-4efd-9d86-15c070b7895e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.111648 Jun 30 18:43:17.867093 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 594/1179] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 30 18:43:17 2022] POST /compute/v2.1/servers/4281e4fd-b31a-4efd-9d86-15c070b7895e/os-volume_attachments => generated 174 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 30 18:43:17.871364 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-0fc9c214-d96d-49eb-892d-6c28769800dc tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:43:17.871885 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-0fc9c214-d96d-49eb-892d-6c28769800dc tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 4281e4fd-b31a-4efd-9d86-15c070b7895e] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:43:17.877974 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0fc9c214-d96d-49eb-892d-6c28769800dc tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:17.878417 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0fc9c214-d96d-49eb-892d-6c28769800dc tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:17.879166 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0fc9c214-d96d-49eb-892d-6c28769800dc tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:17.879596 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0fc9c214-d96d-49eb-892d-6c28769800dc tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:17.903941 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-0fc9c214-d96d-49eb-892d-6c28769800dc tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 4281e4fd-b31a-4efd-9d86-15c070b7895e] Going to try to terminate instance {{(pid=117940) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 18:43:17.975795 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-0fc9c214-d96d-49eb-892d-6c28769800dc tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4281e4fd-b31a-4efd-9d86-15c070b7895e" status: 204 len: 0 microversion: 2.1 time: 0.108400 Jun 30 18:43:17.976684 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 586/1180] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 30 18:43:17 2022] DELETE /compute/v2.1/servers/4281e4fd-b31a-4efd-9d86-15c070b7895e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 30 18:43:17.986236 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-681671b9-1cfe-4dfd-b352-754bc70c1f13 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:43:17.986843 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-681671b9-1cfe-4dfd-b352-754bc70c1f13 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 4281e4fd-b31a-4efd-9d86-15c070b7895e] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:43:17.993512 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-681671b9-1cfe-4dfd-b352-754bc70c1f13 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:17.993971 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-681671b9-1cfe-4dfd-b352-754bc70c1f13 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:17.994712 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-681671b9-1cfe-4dfd-b352-754bc70c1f13 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:17.995133 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-681671b9-1cfe-4dfd-b352-754bc70c1f13 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:18.126582 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-681671b9-1cfe-4dfd-b352-754bc70c1f13 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:43:18.134654 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-681671b9-1cfe-4dfd-b352-754bc70c1f13 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/4281e4fd-b31a-4efd-9d86-15c070b7895e" status: 200 len: 1681 microversion: 2.1 time: 0.153597 Jun 30 18:43:18.135231 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 595/1181] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:43:17 2022] GET /compute/v2.1/servers/4281e4fd-b31a-4efd-9d86-15c070b7895e => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:43:19.154164 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-0e07643b-3466-4c6c-a978-5778f95eca01 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:43:19.154863 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-0e07643b-3466-4c6c-a978-5778f95eca01 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 4281e4fd-b31a-4efd-9d86-15c070b7895e] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:43:19.161235 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0e07643b-3466-4c6c-a978-5778f95eca01 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:19.161715 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0e07643b-3466-4c6c-a978-5778f95eca01 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:19.162479 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0e07643b-3466-4c6c-a978-5778f95eca01 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:19.162919 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0e07643b-3466-4c6c-a978-5778f95eca01 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:19.297393 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-0e07643b-3466-4c6c-a978-5778f95eca01 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:43:19.305170 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-0e07643b-3466-4c6c-a978-5778f95eca01 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/4281e4fd-b31a-4efd-9d86-15c070b7895e" status: 200 len: 1681 microversion: 2.1 time: 0.155443 Jun 30 18:43:19.305772 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 587/1182] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:43:19 2022] GET /compute/v2.1/servers/4281e4fd-b31a-4efd-9d86-15c070b7895e => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:43:20.322555 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-7c6375d3-534f-44aa-baef-c4f22956a891 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:43:20.323174 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-7c6375d3-534f-44aa-baef-c4f22956a891 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 4281e4fd-b31a-4efd-9d86-15c070b7895e] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:43:20.330221 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7c6375d3-534f-44aa-baef-c4f22956a891 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:20.330659 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7c6375d3-534f-44aa-baef-c4f22956a891 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:20.331398 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7c6375d3-534f-44aa-baef-c4f22956a891 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:20.331823 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7c6375d3-534f-44aa-baef-c4f22956a891 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:20.523011 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-7c6375d3-534f-44aa-baef-c4f22956a891 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:43:20.530868 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-7c6375d3-534f-44aa-baef-c4f22956a891 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/4281e4fd-b31a-4efd-9d86-15c070b7895e" status: 200 len: 1681 microversion: 2.1 time: 0.212087 Jun 30 18:43:20.531436 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 596/1183] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:43:20 2022] GET /compute/v2.1/servers/4281e4fd-b31a-4efd-9d86-15c070b7895e => generated 1681 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:43:20.823402 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [req-631a6e3d-374d-4ef0-b2c6-b42d62897a6e req-c30eed37-bb53-45a1-861e-2020a4af0ac8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4281e4fd-b31a-4efd-9d86-15c070b7895e", "name": "network-vif-deleted", "tag": "9a744f53-9af2-4037-a700-c94f628f6144"}]} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:43:20.832804 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-631a6e3d-374d-4ef0-b2c6-b42d62897a6e req-c30eed37-bb53-45a1-861e-2020a4af0ac8 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:20.833320 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-631a6e3d-374d-4ef0-b2c6-b42d62897a6e req-c30eed37-bb53-45a1-861e-2020a4af0ac8 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:20.846821 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.compute.server_external_events [req-631a6e3d-374d-4ef0-b2c6-b42d62897a6e req-c30eed37-bb53-45a1-861e-2020a4af0ac8 service nova] Creating event network-vif-deleted:9a744f53-9af2-4037-a700-c94f628f6144 for instance 4281e4fd-b31a-4efd-9d86-15c070b7895e on hv-cinder-80378 Jun 30 18:43:20.855371 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [req-631a6e3d-374d-4ef0-b2c6-b42d62897a6e req-c30eed37-bb53-45a1-861e-2020a4af0ac8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035668 Jun 30 18:43:20.856320 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 588/1184] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:43:21.548553 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-6f655e9d-ea90-406b-b907-6ee25667b72d tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:43:21.549156 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-6f655e9d-ea90-406b-b907-6ee25667b72d tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 4281e4fd-b31a-4efd-9d86-15c070b7895e] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:43:21.555791 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6f655e9d-ea90-406b-b907-6ee25667b72d tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:21.556239 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6f655e9d-ea90-406b-b907-6ee25667b72d tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:21.557237 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6f655e9d-ea90-406b-b907-6ee25667b72d tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:21.557708 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6f655e9d-ea90-406b-b907-6ee25667b72d tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:21.571655 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.wsgi [None req-6f655e9d-ea90-406b-b907-6ee25667b72d tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] HTTP exception thrown: Instance 4281e4fd-b31a-4efd-9d86-15c070b7895e could not be found. Jun 30 18:43:21.573193 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-6f655e9d-ea90-406b-b907-6ee25667b72d tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Request method failure captured: Jun 30 18:43:21.573193 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: request: GET /compute/v2.1/servers/4281e4fd-b31a-4efd-9d86-15c070b7895e HTTP/1.1 Jun 30 18:43:21.573193 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept: application/json Jun 30 18:43:21.573193 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept-Encoding: identity Jun 30 18:43:21.573193 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Connection: close Jun 30 18:43:21.573193 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Length: 0 Jun 30 18:43:21.573193 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Type: application/json Jun 30 18:43:21.573193 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Host: 10.222.0.33 Jun 30 18:43:21.573193 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Openstack-System-Scope: None Jun 30 18:43:21.573193 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: User-Agent: python-urllib3/1.26.9 Jun 30 18:43:21.573193 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Auth-Token: gAAAAABive3_mQ4kZ2JNveNggCM2j6Qam1PzZzze4niNBx_ABO6k3xVntyI41bCtbU1dqHi3AaxJKokcovO0E907Am7gbM4_Spd2N8jkkVzqboNWXgAyxs4i5CVIc1cpe4RDkM3IBciZBWXtbJ1cU6IuTIKWreKtjsnNHJNRFm0dFUHScNhmgkQ Jun 30 18:43:21.573193 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Id: None Jun 30 18:43:21.573193 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Name: None Jun 30 18:43:21.573193 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Identity-Status: Confirmed Jun 30 18:43:21.573193 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Is-Admin-Project: True Jun 30 18:43:21.573193 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Id: default Jun 30 18:43:21.573193 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Name: Default Jun 30 18:43:21.573193 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Id: b8227be3d9a044ed888b2f54abd9463d Jun 30 18:43:21.573193 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Name: tempest-AttachVolumeNegativeTest-1944998081 Jun 30 18:43:21.573193 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Role: reader,member Jun 30 18:43:21.573193 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Roles: reader,member Jun 30 18:43:21.574993 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b8227be3d9a044ed888b2f54abd9463d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b8227be3d9a044ed888b2f54abd9463d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b8227be3d9a044ed888b2f54abd9463d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b8227be3d9a044ed888b2f54abd9463d"}]}] Jun 30 18:43:21.574993 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant: tempest-AttachVolumeNegativeTest-1944998081 Jun 30 18:43:21.574993 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Id: b8227be3d9a044ed888b2f54abd9463d Jun 30 18:43:21.574993 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1944998081 Jun 30 18:43:21.574993 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User: tempest-AttachVolumeNegativeTest-1944998081-project Jun 30 18:43:21.574993 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Id: default Jun 30 18:43:21.574993 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Name: Default Jun 30 18:43:21.574993 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Id: 9531d18446eb4488bbd1511cb3412925 Jun 30 18:43:21.574993 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Name: tempest-AttachVolumeNegativeTest-1944998081-project Jun 30 18:43:21.574993 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: method: > Jun 30 18:43:21.574993 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: exception: Instance 4281e4fd-b31a-4efd-9d86-15c070b7895e could not be found. Jun 30 18:43:21.574993 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: action_args: {'id': '4281e4fd-b31a-4efd-9d86-15c070b7895e'} Jun 30 18:43:21.575810 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:43:21.575810 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:43:21.575810 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:43:21.575810 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:43:21.575810 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:43:21.575810 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:43:21.575810 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:43:21.575810 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:43:21.575810 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:43:21.575810 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:43:21.575810 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4281e4fd-b31a-4efd-9d86-15c070b7895e could not be found. Jun 30 18:43:21.575810 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:43:21.575810 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:43:21.575810 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:43:21.575810 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:43:21.575810 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:43:21.575810 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:43:21.575810 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:43:21.575810 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:43:21.575810 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:43:21.577108 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:43:21.577108 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:43:21.577108 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:43:21.577108 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:43:21.577108 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:43:21.577108 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:43:21.577108 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:43:21.577108 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4281e4fd-b31a-4efd-9d86-15c070b7895e could not be found. Jun 30 18:43:21.577108 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:43:21.577108 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:43:21.577108 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:43:21.577108 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:43:21.577108 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:43:21.577108 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:43:21.577108 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:43:21.577108 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:43:21.577108 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4281e4fd-b31a-4efd-9d86-15c070b7895e could not be found. Jun 30 18:43:21.577108 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:43:21.578383 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-6f655e9d-ea90-406b-b907-6ee25667b72d tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Returning 404 to user: Instance 4281e4fd-b31a-4efd-9d86-15c070b7895e could not be found. {{(pid=117941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:43:21.578383 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-6f655e9d-ea90-406b-b907-6ee25667b72d tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/4281e4fd-b31a-4efd-9d86-15c070b7895e" status: 404 len: 111 microversion: 2.1 time: 0.030241 Jun 30 18:43:21.578383 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 597/1185] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:43:21 2022] GET /compute/v2.1/servers/4281e4fd-b31a-4efd-9d86-15c070b7895e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:43:21.584412 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-cccec707-fb24-459d-a4eb-e1a51e61d338 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '.version_select at 0x7f1804bb0d30>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:43:21.604408 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-cccec707-fb24-459d-a4eb-e1a51e61d338 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1112874546" status: 202 len: 0 microversion: 2.1 time: 0.024035 Jun 30 18:43:21.605611 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 589/1186] 10.222.0.33 () {58 vars in 1220 bytes} [Thu Jun 30 18:43:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1112874546 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 18:43:22.268152 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-c39c27d9-1405-409b-81e5-03283bf09a6c tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:43:22.268644 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-c39c27d9-1405-409b-81e5-03283bf09a6c tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: f83962b1-e24e-41ad-969a-b5d8bc609f2c] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:43:22.274576 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c39c27d9-1405-409b-81e5-03283bf09a6c tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:22.275022 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c39c27d9-1405-409b-81e5-03283bf09a6c tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:22.275776 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c39c27d9-1405-409b-81e5-03283bf09a6c tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:22.276209 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c39c27d9-1405-409b-81e5-03283bf09a6c tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:22.354894 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.objects.instance [None req-c39c27d9-1405-409b-81e5-03283bf09a6c tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lazy-loading 'services' on Instance uuid f83962b1-e24e-41ad-969a-b5d8bc609f2c {{(pid=117941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 18:43:22.426181 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-c39c27d9-1405-409b-81e5-03283bf09a6c tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c/os-volume_attachments/be142546-76cd-452e-8bef-348e924f5787" status: 202 len: 0 microversion: 2.1 time: 0.161713 Jun 30 18:43:22.426888 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 598/1187] 10.222.0.33 () {58 vars in 1415 bytes} [Thu Jun 30 18:43:22 2022] DELETE /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c/os-volume_attachments/be142546-76cd-452e-8bef-348e924f5787 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 18:43:22.435960 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-1ad2de98-1ae4-4085-818a-c52b4b8da6d4 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:43:22.436985 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-1ad2de98-1ae4-4085-818a-c52b4b8da6d4 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: f83962b1-e24e-41ad-969a-b5d8bc609f2c] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:43:22.443609 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-1ad2de98-1ae4-4085-818a-c52b4b8da6d4 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:22.444056 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-1ad2de98-1ae4-4085-818a-c52b4b8da6d4 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:22.444810 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-1ad2de98-1ae4-4085-818a-c52b4b8da6d4 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:22.445247 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-1ad2de98-1ae4-4085-818a-c52b4b8da6d4 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:22.481313 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-1ad2de98-1ae4-4085-818a-c52b4b8da6d4 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050012 Jun 30 18:43:22.482011 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 590/1188] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 30 18:43:22 2022] GET /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:43:23.493896 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-79ddb5bf-19d0-4441-b441-4866e76b3244 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:43:23.494949 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-79ddb5bf-19d0-4441-b441-4866e76b3244 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: f83962b1-e24e-41ad-969a-b5d8bc609f2c] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:43:23.501119 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-79ddb5bf-19d0-4441-b441-4866e76b3244 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:23.501563 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-79ddb5bf-19d0-4441-b441-4866e76b3244 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:23.502340 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-79ddb5bf-19d0-4441-b441-4866e76b3244 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:23.502767 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-79ddb5bf-19d0-4441-b441-4866e76b3244 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:23.531615 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-79ddb5bf-19d0-4441-b441-4866e76b3244 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042648 Jun 30 18:43:23.532178 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 599/1189] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 30 18:43:23 2022] GET /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 18:43:23.588850 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-bed7aae8-5d64-4dcd-b37d-a78ce4cfaecf tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:43:23.590068 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-bed7aae8-5d64-4dcd-b37d-a78ce4cfaecf tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: f83962b1-e24e-41ad-969a-b5d8bc609f2c] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:43:23.596415 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-bed7aae8-5d64-4dcd-b37d-a78ce4cfaecf tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:23.596864 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-bed7aae8-5d64-4dcd-b37d-a78ce4cfaecf tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:23.597653 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-bed7aae8-5d64-4dcd-b37d-a78ce4cfaecf tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:23.598088 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-bed7aae8-5d64-4dcd-b37d-a78ce4cfaecf tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:23.622525 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-bed7aae8-5d64-4dcd-b37d-a78ce4cfaecf tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: f83962b1-e24e-41ad-969a-b5d8bc609f2c] Going to try to terminate instance {{(pid=117940) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 18:43:23.695627 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-bed7aae8-5d64-4dcd-b37d-a78ce4cfaecf tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c" status: 204 len: 0 microversion: 2.1 time: 0.110368 Jun 30 18:43:23.696470 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 591/1190] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 30 18:43:23 2022] DELETE /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 18:43:23.706095 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-db3e4011-f5fa-4c4f-85ca-6934711b87cc tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:43:23.706705 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-db3e4011-f5fa-4c4f-85ca-6934711b87cc tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: f83962b1-e24e-41ad-969a-b5d8bc609f2c] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:43:23.712700 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-db3e4011-f5fa-4c4f-85ca-6934711b87cc tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:23.713150 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-db3e4011-f5fa-4c4f-85ca-6934711b87cc tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:23.713928 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-db3e4011-f5fa-4c4f-85ca-6934711b87cc tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:23.715190 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-db3e4011-f5fa-4c4f-85ca-6934711b87cc tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:23.848825 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-db3e4011-f5fa-4c4f-85ca-6934711b87cc tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:43:23.856426 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-db3e4011-f5fa-4c4f-85ca-6934711b87cc tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c" status: 200 len: 1680 microversion: 2.1 time: 0.154509 Jun 30 18:43:23.856990 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 600/1191] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:43:23 2022] GET /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:43:24.874000 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-fd58d58c-0828-4426-a359-db75b3a24ccb tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:43:24.874701 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-fd58d58c-0828-4426-a359-db75b3a24ccb tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: f83962b1-e24e-41ad-969a-b5d8bc609f2c] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:43:24.881097 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fd58d58c-0828-4426-a359-db75b3a24ccb tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:24.881545 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fd58d58c-0828-4426-a359-db75b3a24ccb tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:24.882335 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fd58d58c-0828-4426-a359-db75b3a24ccb tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:24.882769 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-fd58d58c-0828-4426-a359-db75b3a24ccb tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:25.013971 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-fd58d58c-0828-4426-a359-db75b3a24ccb tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:43:25.021561 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-fd58d58c-0828-4426-a359-db75b3a24ccb tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c" status: 200 len: 1680 microversion: 2.1 time: 0.152455 Jun 30 18:43:25.022154 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 592/1192] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:43:24 2022] GET /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:43:26.039901 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-104e2367-f962-4bcd-ba34-955c142e9ede tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:43:26.040620 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-104e2367-f962-4bcd-ba34-955c142e9ede tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: f83962b1-e24e-41ad-969a-b5d8bc609f2c] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:43:26.047264 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-104e2367-f962-4bcd-ba34-955c142e9ede tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:26.047722 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-104e2367-f962-4bcd-ba34-955c142e9ede tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:26.048482 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-104e2367-f962-4bcd-ba34-955c142e9ede tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:26.048917 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-104e2367-f962-4bcd-ba34-955c142e9ede tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:26.232745 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-104e2367-f962-4bcd-ba34-955c142e9ede tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:43:26.240561 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-104e2367-f962-4bcd-ba34-955c142e9ede tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c" status: 200 len: 1680 microversion: 2.1 time: 0.204484 Jun 30 18:43:26.241131 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 601/1193] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:43:26 2022] GET /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c => generated 1680 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:43:26.581336 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [req-ded07945-f635-4ff4-8568-5c1e7756f662 req-5f66f1ab-7416-4a02-b329-d525ad96d995 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f83962b1-e24e-41ad-969a-b5d8bc609f2c", "name": "network-vif-deleted", "tag": "9679e7ce-ab18-4116-94b9-2852dee5cfe7"}]} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:43:26.591861 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-ded07945-f635-4ff4-8568-5c1e7756f662 req-5f66f1ab-7416-4a02-b329-d525ad96d995 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:26.592390 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-ded07945-f635-4ff4-8568-5c1e7756f662 req-5f66f1ab-7416-4a02-b329-d525ad96d995 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:26.603835 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.compute.server_external_events [req-ded07945-f635-4ff4-8568-5c1e7756f662 req-5f66f1ab-7416-4a02-b329-d525ad96d995 service nova] Creating event network-vif-deleted:9679e7ce-ab18-4116-94b9-2852dee5cfe7 for instance f83962b1-e24e-41ad-969a-b5d8bc609f2c on hv-cinder-80378 Jun 30 18:43:26.610535 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [req-ded07945-f635-4ff4-8568-5c1e7756f662 req-5f66f1ab-7416-4a02-b329-d525ad96d995 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033733 Jun 30 18:43:26.611449 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 593/1194] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:43:27.258815 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-63ab4eaf-081c-40f5-997c-969d2a66f407 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:43:27.259568 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-63ab4eaf-081c-40f5-997c-969d2a66f407 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: f83962b1-e24e-41ad-969a-b5d8bc609f2c] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:43:27.266869 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-63ab4eaf-081c-40f5-997c-969d2a66f407 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:27.267526 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-63ab4eaf-081c-40f5-997c-969d2a66f407 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:27.268063 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-63ab4eaf-081c-40f5-997c-969d2a66f407 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:27.268590 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-63ab4eaf-081c-40f5-997c-969d2a66f407 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:27.282930 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.wsgi [None req-63ab4eaf-081c-40f5-997c-969d2a66f407 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] HTTP exception thrown: Instance f83962b1-e24e-41ad-969a-b5d8bc609f2c could not be found. Jun 30 18:43:27.284582 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-63ab4eaf-081c-40f5-997c-969d2a66f407 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Request method failure captured: Jun 30 18:43:27.284582 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: request: GET /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c HTTP/1.1 Jun 30 18:43:27.284582 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept: application/json Jun 30 18:43:27.284582 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept-Encoding: identity Jun 30 18:43:27.284582 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Connection: close Jun 30 18:43:27.284582 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Length: 0 Jun 30 18:43:27.284582 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Type: application/json Jun 30 18:43:27.284582 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Host: 10.222.0.33 Jun 30 18:43:27.284582 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Openstack-System-Scope: None Jun 30 18:43:27.284582 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: User-Agent: python-urllib3/1.26.9 Jun 30 18:43:27.284582 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Auth-Token: gAAAAABive3_mQ4kZ2JNveNggCM2j6Qam1PzZzze4niNBx_ABO6k3xVntyI41bCtbU1dqHi3AaxJKokcovO0E907Am7gbM4_Spd2N8jkkVzqboNWXgAyxs4i5CVIc1cpe4RDkM3IBciZBWXtbJ1cU6IuTIKWreKtjsnNHJNRFm0dFUHScNhmgkQ Jun 30 18:43:27.284582 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Id: None Jun 30 18:43:27.284582 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Name: None Jun 30 18:43:27.284582 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Identity-Status: Confirmed Jun 30 18:43:27.284582 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Is-Admin-Project: True Jun 30 18:43:27.284582 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Id: default Jun 30 18:43:27.284582 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Name: Default Jun 30 18:43:27.284582 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Id: b8227be3d9a044ed888b2f54abd9463d Jun 30 18:43:27.284582 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Name: tempest-AttachVolumeNegativeTest-1944998081 Jun 30 18:43:27.284582 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Role: reader,member Jun 30 18:43:27.284582 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Roles: reader,member Jun 30 18:43:27.286215 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b8227be3d9a044ed888b2f54abd9463d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b8227be3d9a044ed888b2f54abd9463d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b8227be3d9a044ed888b2f54abd9463d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b8227be3d9a044ed888b2f54abd9463d"}]}] Jun 30 18:43:27.286215 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant: tempest-AttachVolumeNegativeTest-1944998081 Jun 30 18:43:27.286215 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Id: b8227be3d9a044ed888b2f54abd9463d Jun 30 18:43:27.286215 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1944998081 Jun 30 18:43:27.286215 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User: tempest-AttachVolumeNegativeTest-1944998081-project Jun 30 18:43:27.286215 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Id: default Jun 30 18:43:27.286215 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Name: Default Jun 30 18:43:27.286215 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Id: 9531d18446eb4488bbd1511cb3412925 Jun 30 18:43:27.286215 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Name: tempest-AttachVolumeNegativeTest-1944998081-project Jun 30 18:43:27.286215 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: method: > Jun 30 18:43:27.286215 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: exception: Instance f83962b1-e24e-41ad-969a-b5d8bc609f2c could not be found. Jun 30 18:43:27.286215 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: action_args: {'id': 'f83962b1-e24e-41ad-969a-b5d8bc609f2c'} Jun 30 18:43:27.287159 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:43:27.287159 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:43:27.287159 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:43:27.287159 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:43:27.287159 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:43:27.287159 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:43:27.287159 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:43:27.287159 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:43:27.287159 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:43:27.287159 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:43:27.287159 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f83962b1-e24e-41ad-969a-b5d8bc609f2c could not be found. Jun 30 18:43:27.287159 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:43:27.287159 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:43:27.287159 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:43:27.287159 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:43:27.287159 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:43:27.287159 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:43:27.287159 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:43:27.287159 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:43:27.287159 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:43:27.289284 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:43:27.289284 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:43:27.289284 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:43:27.289284 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:43:27.289284 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:43:27.289284 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:43:27.289284 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:43:27.289284 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f83962b1-e24e-41ad-969a-b5d8bc609f2c could not be found. Jun 30 18:43:27.289284 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:43:27.289284 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:43:27.289284 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:43:27.289284 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:43:27.289284 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:43:27.289284 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:43:27.289284 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:43:27.289284 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:43:27.289284 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f83962b1-e24e-41ad-969a-b5d8bc609f2c could not be found. Jun 30 18:43:27.289284 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:43:27.291398 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-63ab4eaf-081c-40f5-997c-969d2a66f407 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Returning 404 to user: Instance f83962b1-e24e-41ad-969a-b5d8bc609f2c could not be found. {{(pid=117941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:43:27.291398 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-63ab4eaf-081c-40f5-997c-969d2a66f407 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c" status: 404 len: 111 microversion: 2.1 time: 0.031116 Jun 30 18:43:27.291398 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 602/1195] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:43:27 2022] GET /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:43:27.295574 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-03e18660-6de6-46f8-84c3-432cc5d6bc26 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '.version_select at 0x7f1804acc0d0>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:43:27.312765 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-03e18660-6de6-46f8-84c3-432cc5d6bc26 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-543578275" status: 202 len: 0 microversion: 2.1 time: 0.021332 Jun 30 18:43:27.313324 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 594/1196] 10.222.0.33 () {58 vars in 1217 bytes} [Thu Jun 30 18:43:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-543578275 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 18:43:27.950775 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-0f9e06d9-f226-4781-8dbc-885db4f0850a tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Action: 'create', calling method: .version_select at 0x7f18094c8040>, body: {"keypair": {"name": "tempest-keypair-909220423", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPvDIY57sZGaHy2sEPl6/TVKvuEbHNDc+u0Nq4WCHgzp/cbCz93mJ3jvceZAUrl6jVrrYFZsUk5v3zls4gaWTRJ8eOe+/FdQLjmX6U7/cfl/po0am8Hk3tw/kmjWzkUBHQ=="}} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:43:27.964861 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.quota [None req-0f9e06d9-f226-4781-8dbc-885db4f0850a tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Getting quotas for project b8227be3d9a044ed888b2f54abd9463d. Resources: {'key_pairs'} {{(pid=117941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 18:43:27.968761 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.quota [None req-0f9e06d9-f226-4781-8dbc-885db4f0850a tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Getting quotas for user 9531d18446eb4488bbd1511cb3412925 and project b8227be3d9a044ed888b2f54abd9463d. Resources: {'key_pairs'} {{(pid=117941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 18:43:27.991697 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-0f9e06d9-f226-4781-8dbc-885db4f0850a tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044804 Jun 30 18:43:27.992283 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 603/1197] 10.222.0.33 () {60 vars in 1158 bytes} [Thu Jun 30 18:43:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:43:29.252512 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-bf65c20c-8463-4b3d-8c2e-95738eea2d3d tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-552813523", "imageRef": "636d6d52-5033-47e1-bf75-0b4fc50c0bb0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c75ba402-1254-4901-ad58-40e30172cc26"}], "security_groups": [{"name": "tempest-securitygroup--904198037"}], "key_name": "tempest-keypair-909220423", "user_data": "}} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:43:29.537763 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.network.neutron [None req-bf65c20c-8463-4b3d-8c2e-95738eea2d3d tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] validate_networks() for [('c75ba402-1254-4901-ad58-40e30172cc26', None, None, None, None, None)] {{(pid=117940) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 18:43:30.160426 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-bf65c20c-8463-4b3d-8c2e-95738eea2d3d tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Flavor limits 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 18:43:30.160869 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-bf65c20c-8463-4b3d-8c2e-95738eea2d3d tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Image limits 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 18:43:30.161332 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-bf65c20c-8463-4b3d-8c2e-95738eea2d3d tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Flavor pref 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 18:43:30.161771 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-bf65c20c-8463-4b3d-8c2e-95738eea2d3d tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Image pref 0:0:0 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 18:43:30.162177 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.virt.hardware [None req-bf65c20c-8463-4b3d-8c2e-95738eea2d3d tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117940) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 18:43:30.171459 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-bf65c20c-8463-4b3d-8c2e-95738eea2d3d tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:30.171893 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-bf65c20c-8463-4b3d-8c2e-95738eea2d3d tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:30.172694 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-bf65c20c-8463-4b3d-8c2e-95738eea2d3d tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:30.173122 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-bf65c20c-8463-4b3d-8c2e-95738eea2d3d tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:30.190186 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.quota [None req-bf65c20c-8463-4b3d-8c2e-95738eea2d3d tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Getting quotas for project b8227be3d9a044ed888b2f54abd9463d. Resources: {'ram', 'instances', 'cores'} {{(pid=117940) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 18:43:30.194024 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.quota [None req-bf65c20c-8463-4b3d-8c2e-95738eea2d3d tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Getting quotas for user 9531d18446eb4488bbd1511cb3412925 and project b8227be3d9a044ed888b2f54abd9463d. Resources: {'ram', 'instances', 'cores'} {{(pid=117940) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 18:43:30.204643 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-bf65c20c-8463-4b3d-8c2e-95738eea2d3d tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Going to run 1 instances... {{(pid=117940) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 18:43:30.206963 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-bf65c20c-8463-4b3d-8c2e-95738eea2d3d tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: ee34e802-b1fb-4445-a92f-8860154b9e2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='636d6d52-5033-47e1-bf75-0b4fc50c0bb0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117940) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 18:43:30.254379 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-bf65c20c-8463-4b3d-8c2e-95738eea2d3d tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.006636 Jun 30 18:43:30.255025 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 595/1198] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 30 18:43:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 1008 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 18:43:30.265224 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-a992deda-ae33-46b5-bdbf-544278c241c8 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:43:30.265992 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-a992deda-ae33-46b5-bdbf-544278c241c8 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: ee34e802-b1fb-4445-a92f-8860154b9e2d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:43:30.427009 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-a992deda-ae33-46b5-bdbf-544278c241c8 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:43:30.434426 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-a992deda-ae33-46b5-bdbf-544278c241c8 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d" status: 200 len: 1240 microversion: 2.1 time: 0.173369 Jun 30 18:43:30.434986 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 604/1199] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:43:30 2022] GET /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d => generated 1240 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:43:31.457554 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-cd9dfe04-8f7e-4acd-a6c3-450220375f19 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:43:31.458181 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-cd9dfe04-8f7e-4acd-a6c3-450220375f19 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: ee34e802-b1fb-4445-a92f-8860154b9e2d] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:43:31.467071 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cd9dfe04-8f7e-4acd-a6c3-450220375f19 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:31.468101 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cd9dfe04-8f7e-4acd-a6c3-450220375f19 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:31.469842 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cd9dfe04-8f7e-4acd-a6c3-450220375f19 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:31.470293 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cd9dfe04-8f7e-4acd-a6c3-450220375f19 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:31.561823 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-cd9dfe04-8f7e-4acd-a6c3-450220375f19 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:43:31.569521 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-cd9dfe04-8f7e-4acd-a6c3-450220375f19 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d" status: 200 len: 1298 microversion: 2.1 time: 0.121198 Jun 30 18:43:31.570145 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 596/1200] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:43:31 2022] GET /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d => generated 1298 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:43:32.589004 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-bdfe203f-c1c0-4fd1-b481-704392c419f4 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:43:32.589680 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-bdfe203f-c1c0-4fd1-b481-704392c419f4 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: ee34e802-b1fb-4445-a92f-8860154b9e2d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:43:32.596214 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-bdfe203f-c1c0-4fd1-b481-704392c419f4 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:32.596642 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-bdfe203f-c1c0-4fd1-b481-704392c419f4 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:32.597404 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-bdfe203f-c1c0-4fd1-b481-704392c419f4 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:32.597864 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-bdfe203f-c1c0-4fd1-b481-704392c419f4 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:32.805237 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-bdfe203f-c1c0-4fd1-b481-704392c419f4 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:43:32.812732 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-bdfe203f-c1c0-4fd1-b481-704392c419f4 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d" status: 200 len: 1365 microversion: 2.1 time: 0.228394 Jun 30 18:43:32.813305 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 605/1201] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:43:32 2022] GET /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d => generated 1365 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:43:32.946058 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [req-92b18de6-6e20-436a-a95f-b8379747e222 req-3a8dcd67-8380-4d39-9023-7884af435a18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee34e802-b1fb-4445-a92f-8860154b9e2d", "tag": "44b86c8d-2449-4cbd-b49a-36ec9c0aaa4b"}]} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:43:32.960831 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-92b18de6-6e20-436a-a95f-b8379747e222 req-3a8dcd67-8380-4d39-9023-7884af435a18 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:32.961290 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-92b18de6-6e20-436a-a95f-b8379747e222 req-3a8dcd67-8380-4d39-9023-7884af435a18 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:32.975393 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.compute.server_external_events [req-92b18de6-6e20-436a-a95f-b8379747e222 req-3a8dcd67-8380-4d39-9023-7884af435a18 service nova] Creating event network-changed:44b86c8d-2449-4cbd-b49a-36ec9c0aaa4b for instance ee34e802-b1fb-4445-a92f-8860154b9e2d on hv-cinder-80378 Jun 30 18:43:32.982738 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [req-92b18de6-6e20-436a-a95f-b8379747e222 req-3a8dcd67-8380-4d39-9023-7884af435a18 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042938 Jun 30 18:43:32.983684 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 597/1202] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:43:33.829513 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-9f6f6390-b8fa-44b7-aea0-9eebcb4c08ba tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:43:33.830143 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-9f6f6390-b8fa-44b7-aea0-9eebcb4c08ba tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: ee34e802-b1fb-4445-a92f-8860154b9e2d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:43:33.838595 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9f6f6390-b8fa-44b7-aea0-9eebcb4c08ba tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:33.839132 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9f6f6390-b8fa-44b7-aea0-9eebcb4c08ba tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:33.840064 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9f6f6390-b8fa-44b7-aea0-9eebcb4c08ba tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:33.840344 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-9f6f6390-b8fa-44b7-aea0-9eebcb4c08ba tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:33.973791 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-9f6f6390-b8fa-44b7-aea0-9eebcb4c08ba tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:43:33.981665 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-9f6f6390-b8fa-44b7-aea0-9eebcb4c08ba tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d" status: 200 len: 1365 microversion: 2.1 time: 0.156047 Jun 30 18:43:33.982233 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 606/1203] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:43:33 2022] GET /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:43:34.999616 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-30e0bb5c-0e3c-4cd3-ab17-476a34d5adec tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:43:35.000384 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-30e0bb5c-0e3c-4cd3-ab17-476a34d5adec tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: ee34e802-b1fb-4445-a92f-8860154b9e2d] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:43:35.007518 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-30e0bb5c-0e3c-4cd3-ab17-476a34d5adec tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:35.007966 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-30e0bb5c-0e3c-4cd3-ab17-476a34d5adec tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:35.008723 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-30e0bb5c-0e3c-4cd3-ab17-476a34d5adec tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:35.009159 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-30e0bb5c-0e3c-4cd3-ab17-476a34d5adec tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:35.146866 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-30e0bb5c-0e3c-4cd3-ab17-476a34d5adec tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:43:35.154223 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-30e0bb5c-0e3c-4cd3-ab17-476a34d5adec tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d" status: 200 len: 1365 microversion: 2.1 time: 0.158919 Jun 30 18:43:35.154788 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 598/1204] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:43:34 2022] GET /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:43:36.170771 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-f35eae66-bf4a-4cfd-ad75-be1e02d3b2ab tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:43:36.171302 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-f35eae66-bf4a-4cfd-ad75-be1e02d3b2ab tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: ee34e802-b1fb-4445-a92f-8860154b9e2d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:43:36.178076 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f35eae66-bf4a-4cfd-ad75-be1e02d3b2ab tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:36.178524 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f35eae66-bf4a-4cfd-ad75-be1e02d3b2ab tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:36.179283 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f35eae66-bf4a-4cfd-ad75-be1e02d3b2ab tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:36.179714 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f35eae66-bf4a-4cfd-ad75-be1e02d3b2ab tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:36.314848 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-f35eae66-bf4a-4cfd-ad75-be1e02d3b2ab tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:43:36.322779 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-f35eae66-bf4a-4cfd-ad75-be1e02d3b2ab tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d" status: 200 len: 1365 microversion: 2.1 time: 0.155446 Jun 30 18:43:36.323338 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 607/1205] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:43:36 2022] GET /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:43:37.340425 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-2215e8d4-c2b0-497b-82db-ffa6bd4efaa4 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:43:37.341067 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-2215e8d4-c2b0-497b-82db-ffa6bd4efaa4 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: ee34e802-b1fb-4445-a92f-8860154b9e2d] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:43:37.347601 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-2215e8d4-c2b0-497b-82db-ffa6bd4efaa4 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:37.348045 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-2215e8d4-c2b0-497b-82db-ffa6bd4efaa4 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:37.348790 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-2215e8d4-c2b0-497b-82db-ffa6bd4efaa4 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:37.349215 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-2215e8d4-c2b0-497b-82db-ffa6bd4efaa4 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:37.486541 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-2215e8d4-c2b0-497b-82db-ffa6bd4efaa4 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:43:37.494202 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-2215e8d4-c2b0-497b-82db-ffa6bd4efaa4 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d" status: 200 len: 1365 microversion: 2.1 time: 0.158400 Jun 30 18:43:37.494837 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 599/1206] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:43:37 2022] GET /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:43:38.511321 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-7e900bd0-1299-4b44-9b05-edadb40e31a4 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:43:38.511937 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-7e900bd0-1299-4b44-9b05-edadb40e31a4 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: ee34e802-b1fb-4445-a92f-8860154b9e2d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:43:38.518224 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7e900bd0-1299-4b44-9b05-edadb40e31a4 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:38.518663 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7e900bd0-1299-4b44-9b05-edadb40e31a4 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:38.519414 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7e900bd0-1299-4b44-9b05-edadb40e31a4 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:38.519842 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-7e900bd0-1299-4b44-9b05-edadb40e31a4 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:38.657328 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-7e900bd0-1299-4b44-9b05-edadb40e31a4 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:43:38.664652 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-7e900bd0-1299-4b44-9b05-edadb40e31a4 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d" status: 200 len: 1365 microversion: 2.1 time: 0.157469 Jun 30 18:43:38.665222 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 608/1207] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:43:38 2022] GET /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:43:39.130614 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [req-7e1feb4c-9779-4191-a414-19abf4f58a44 req-7cf95cce-3f2d-4d36-8b6d-a9ebaeb2b093 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee34e802-b1fb-4445-a92f-8860154b9e2d", "name": "network-vif-plugged", "status": "completed", "tag": "44b86c8d-2449-4cbd-b49a-36ec9c0aaa4b"}]} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:43:39.139581 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-7e1feb4c-9779-4191-a414-19abf4f58a44 req-7cf95cce-3f2d-4d36-8b6d-a9ebaeb2b093 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:39.140419 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-7e1feb4c-9779-4191-a414-19abf4f58a44 req-7cf95cce-3f2d-4d36-8b6d-a9ebaeb2b093 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:39.152756 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.compute.server_external_events [req-7e1feb4c-9779-4191-a414-19abf4f58a44 req-7cf95cce-3f2d-4d36-8b6d-a9ebaeb2b093 service nova] Creating event network-vif-plugged:44b86c8d-2449-4cbd-b49a-36ec9c0aaa4b for instance ee34e802-b1fb-4445-a92f-8860154b9e2d on hv-cinder-80378 Jun 30 18:43:39.158884 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [req-7e1feb4c-9779-4191-a414-19abf4f58a44 req-7cf95cce-3f2d-4d36-8b6d-a9ebaeb2b093 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032560 Jun 30 18:43:39.159929 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 600/1208] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:43:39.683311 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-71caca8f-eea8-4d10-8405-dbca3bc2b73d tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:43:39.683875 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-71caca8f-eea8-4d10-8405-dbca3bc2b73d tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: ee34e802-b1fb-4445-a92f-8860154b9e2d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:43:39.690345 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-71caca8f-eea8-4d10-8405-dbca3bc2b73d tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:39.690790 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-71caca8f-eea8-4d10-8405-dbca3bc2b73d tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:39.691544 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-71caca8f-eea8-4d10-8405-dbca3bc2b73d tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:39.691976 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-71caca8f-eea8-4d10-8405-dbca3bc2b73d tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:39.817718 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-71caca8f-eea8-4d10-8405-dbca3bc2b73d tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:43:39.825655 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-71caca8f-eea8-4d10-8405-dbca3bc2b73d tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d" status: 200 len: 1365 microversion: 2.1 time: 0.147146 Jun 30 18:43:39.826220 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 609/1209] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:43:39 2022] GET /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:43:40.841570 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell0:SELECT=2 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:43:40.842280 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell0:SELECT=6 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:43:40.846265 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-c2183a8a-3842-4167-bc23-c4b110febb36 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:43:40.847080 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-c2183a8a-3842-4167-bc23-c4b110febb36 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: ee34e802-b1fb-4445-a92f-8860154b9e2d] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:43:40.854223 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c2183a8a-3842-4167-bc23-c4b110febb36 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:40.854718 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c2183a8a-3842-4167-bc23-c4b110febb36 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:40.855584 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c2183a8a-3842-4167-bc23-c4b110febb36 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:40.856017 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c2183a8a-3842-4167-bc23-c4b110febb36 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:40.983789 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-c2183a8a-3842-4167-bc23-c4b110febb36 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:43:40.991104 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-c2183a8a-3842-4167-bc23-c4b110febb36 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d" status: 200 len: 1365 microversion: 2.1 time: 0.151567 Jun 30 18:43:40.991665 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 601/1210] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:43:40 2022] GET /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:43:42.008199 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-6ea3e142-0211-4636-a2a2-53a59ef76bda tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:43:42.008812 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-6ea3e142-0211-4636-a2a2-53a59ef76bda tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: ee34e802-b1fb-4445-a92f-8860154b9e2d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:43:42.011023 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell0:SELECT=6 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:43:42.017289 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6ea3e142-0211-4636-a2a2-53a59ef76bda tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:42.017760 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6ea3e142-0211-4636-a2a2-53a59ef76bda tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:42.018518 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6ea3e142-0211-4636-a2a2-53a59ef76bda tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:42.018950 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6ea3e142-0211-4636-a2a2-53a59ef76bda tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:42.155372 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-6ea3e142-0211-4636-a2a2-53a59ef76bda tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:43:42.162687 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-6ea3e142-0211-4636-a2a2-53a59ef76bda tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d" status: 200 len: 1554 microversion: 2.1 time: 0.158383 Jun 30 18:43:42.163245 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 610/1211] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:43:42 2022] GET /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:43:42.178833 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-3f3e54e1-5e52-44ff-8b3a-74e28f98720b tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:43:42.179342 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-3f3e54e1-5e52-44ff-8b3a-74e28f98720b tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: ee34e802-b1fb-4445-a92f-8860154b9e2d] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:43:42.185947 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3f3e54e1-5e52-44ff-8b3a-74e28f98720b tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:42.186388 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3f3e54e1-5e52-44ff-8b3a-74e28f98720b tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:42.187163 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3f3e54e1-5e52-44ff-8b3a-74e28f98720b tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:42.187587 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3f3e54e1-5e52-44ff-8b3a-74e28f98720b tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:42.264010 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-3f3e54e1-5e52-44ff-8b3a-74e28f98720b tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088891 Jun 30 18:43:42.264601 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 602/1212] 10.222.0.33 () {58 vars in 1274 bytes} [Thu Jun 30 18:43:42 2022] GET /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:43:43.173141 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-523ac97d-0d8f-4680-ac3e-b41193d0a681 req-549d7aa1-7ca0-48df-be19-8a05702da781 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee34e802-b1fb-4445-a92f-8860154b9e2d", "tag": "44b86c8d-2449-4cbd-b49a-36ec9c0aaa4b"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:43:43.181724 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-523ac97d-0d8f-4680-ac3e-b41193d0a681 req-549d7aa1-7ca0-48df-be19-8a05702da781 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:43:43.182161 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-523ac97d-0d8f-4680-ac3e-b41193d0a681 req-549d7aa1-7ca0-48df-be19-8a05702da781 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:43:43.193340 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.compute.server_external_events [req-523ac97d-0d8f-4680-ac3e-b41193d0a681 req-549d7aa1-7ca0-48df-be19-8a05702da781 service nova] Creating event network-changed:44b86c8d-2449-4cbd-b49a-36ec9c0aaa4b for instance ee34e802-b1fb-4445-a92f-8860154b9e2d on hv-cinder-80378 Jun 30 18:43:43.199580 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-523ac97d-0d8f-4680-ac3e-b41193d0a681 req-549d7aa1-7ca0-48df-be19-8a05702da781 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028805 Jun 30 18:43:43.199950 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 611/1213] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:44:55.916041 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:44:55.916791 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:44:55.921298 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-29db3c22-28db-46a9-8759-8d71420ef373 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:44:55.921807 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-29db3c22-28db-46a9-8759-8d71420ef373 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: ee34e802-b1fb-4445-a92f-8860154b9e2d] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:44:55.929836 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-29db3c22-28db-46a9-8759-8d71420ef373 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:44:55.930789 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-29db3c22-28db-46a9-8759-8d71420ef373 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:44:55.931538 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-29db3c22-28db-46a9-8759-8d71420ef373 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:44:55.931965 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-29db3c22-28db-46a9-8759-8d71420ef373 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:44:55.956712 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-29db3c22-28db-46a9-8759-8d71420ef373 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d/ips" status: 200 len: 149 microversion: 2.1 time: 0.042597 Jun 30 18:44:55.957275 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 603/1214] 10.222.0.33 () {58 vars in 1247 bytes} [Thu Jun 30 18:44:55 2022] GET /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:44:57.272306 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:44:57.273046 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=1 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:44:57.277499 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-a31ed33d-1b86-488c-b910-d49578d19b18 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5edb046c-d8df-4685-abbb-f7d6deaaa81b"}} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:44:57.278605 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-a31ed33d-1b86-488c-b910-d49578d19b18 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: ee34e802-b1fb-4445-a92f-8860154b9e2d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:44:57.286099 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a31ed33d-1b86-488c-b910-d49578d19b18 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:44:57.286549 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a31ed33d-1b86-488c-b910-d49578d19b18 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:44:57.287297 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a31ed33d-1b86-488c-b910-d49578d19b18 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:44:57.287729 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a31ed33d-1b86-488c-b910-d49578d19b18 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:44:57.548285 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-a31ed33d-1b86-488c-b910-d49578d19b18 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "POST /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277577 Jun 30 18:44:57.553362 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 612/1215] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 30 18:44:57 2022] POST /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:45:05.143559 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-b3f5c11b-d8f3-4f5a-8c3d-88692a32ff2e tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5edb046c-d8df-4685-abbb-f7d6deaaa81b"}} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:45:05.144603 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-b3f5c11b-d8f3-4f5a-8c3d-88692a32ff2e tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: ee34e802-b1fb-4445-a92f-8860154b9e2d] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:05.151148 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b3f5c11b-d8f3-4f5a-8c3d-88692a32ff2e tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:05.151587 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b3f5c11b-d8f3-4f5a-8c3d-88692a32ff2e tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:05.152326 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b3f5c11b-d8f3-4f5a-8c3d-88692a32ff2e tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:05.152752 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b3f5c11b-d8f3-4f5a-8c3d-88692a32ff2e tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:05.229953 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.wsgi [None req-b3f5c11b-d8f3-4f5a-8c3d-88692a32ff2e tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] HTTP exception thrown: Invalid volume: volume 5edb046c-d8df-4685-abbb-f7d6deaaa81b is already attached to instances: ee34e802-b1fb-4445-a92f-8860154b9e2d Jun 30 18:45:05.231646 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-b3f5c11b-d8f3-4f5a-8c3d-88692a32ff2e tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Request method failure captured: Jun 30 18:45:05.231646 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: request: POST /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d/os-volume_attachments HTTP/1.1 Jun 30 18:45:05.231646 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept: application/json Jun 30 18:45:05.231646 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept-Encoding: identity Jun 30 18:45:05.231646 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Connection: close Jun 30 18:45:05.231646 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Length: 74 Jun 30 18:45:05.231646 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Type: application/json Jun 30 18:45:05.231646 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Host: 10.222.0.33 Jun 30 18:45:05.231646 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Openstack-System-Scope: None Jun 30 18:45:05.231646 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: User-Agent: python-urllib3/1.26.9 Jun 30 18:45:05.231646 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Auth-Token: gAAAAABive3_mQ4kZ2JNveNggCM2j6Qam1PzZzze4niNBx_ABO6k3xVntyI41bCtbU1dqHi3AaxJKokcovO0E907Am7gbM4_Spd2N8jkkVzqboNWXgAyxs4i5CVIc1cpe4RDkM3IBciZBWXtbJ1cU6IuTIKWreKtjsnNHJNRFm0dFUHScNhmgkQ Jun 30 18:45:05.231646 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Id: None Jun 30 18:45:05.231646 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Name: None Jun 30 18:45:05.231646 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Identity-Status: Confirmed Jun 30 18:45:05.231646 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Is-Admin-Project: True Jun 30 18:45:05.231646 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Id: default Jun 30 18:45:05.231646 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Name: Default Jun 30 18:45:05.231646 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Id: b8227be3d9a044ed888b2f54abd9463d Jun 30 18:45:05.231646 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Name: tempest-AttachVolumeNegativeTest-1944998081 Jun 30 18:45:05.231646 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Role: reader,member Jun 30 18:45:05.231646 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Roles: reader,member Jun 30 18:45:05.233416 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b8227be3d9a044ed888b2f54abd9463d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b8227be3d9a044ed888b2f54abd9463d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b8227be3d9a044ed888b2f54abd9463d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b8227be3d9a044ed888b2f54abd9463d"}]}] Jun 30 18:45:05.233416 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant: tempest-AttachVolumeNegativeTest-1944998081 Jun 30 18:45:05.233416 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Id: b8227be3d9a044ed888b2f54abd9463d Jun 30 18:45:05.233416 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1944998081 Jun 30 18:45:05.233416 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User: tempest-AttachVolumeNegativeTest-1944998081-project Jun 30 18:45:05.233416 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Id: default Jun 30 18:45:05.233416 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Name: Default Jun 30 18:45:05.233416 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Id: 9531d18446eb4488bbd1511cb3412925 Jun 30 18:45:05.233416 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Name: tempest-AttachVolumeNegativeTest-1944998081-project Jun 30 18:45:05.233416 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Jun 30 18:45:05.233416 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: {"volumeAttachment": {"volumeId": "5edb046c-d8df-4685-abbb-f7d6deaaa81b"}} Jun 30 18:45:05.233416 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: method: > Jun 30 18:45:05.234406 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: exception: Invalid volume: volume 5edb046c-d8df-4685-abbb-f7d6deaaa81b is already attached to instances: ee34e802-b1fb-4445-a92f-8860154b9e2d Jun 30 18:45:05.234406 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: action_args: {'server_id': 'ee34e802-b1fb-4445-a92f-8860154b9e2d', 'body': {'volumeAttachment': {'volumeId': '5edb046c-d8df-4685-abbb-f7d6deaaa81b'}}} Jun 30 18:45:05.234406 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:45:05.234406 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:45:05.234406 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 30 18:45:05.234406 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 30 18:45:05.234406 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 30 18:45:05.234406 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 30 18:45:05.234406 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 30 18:45:05.234406 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 30 18:45:05.234406 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 30 18:45:05.234406 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 30 18:45:05.234406 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 30 18:45:05.234406 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 30 18:45:05.234406 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5edb046c-d8df-4685-abbb-f7d6deaaa81b is already attached to instances: ee34e802-b1fb-4445-a92f-8860154b9e2d Jun 30 18:45:05.234406 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:45:05.234406 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:45:05.234406 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:45:05.234406 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:45:05.235716 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:45:05.235716 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:45:05.235716 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:45:05.235716 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:45:05.235716 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:45:05.235716 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:45:05.235716 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 18:45:05.235716 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 18:45:05.235716 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 18:45:05.235716 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 18:45:05.235716 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 18:45:05.235716 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 18:45:05.235716 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 30 18:45:05.235716 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 30 18:45:05.235716 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5edb046c-d8df-4685-abbb-f7d6deaaa81b is already attached to instances: ee34e802-b1fb-4445-a92f-8860154b9e2d Jun 30 18:45:05.235716 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:45:05.235716 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:45:05.235716 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:45:05.235716 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:45:05.235716 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:45:05.237066 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:45:05.237066 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:45:05.237066 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:45:05.237066 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5edb046c-d8df-4685-abbb-f7d6deaaa81b is already attached to instances: ee34e802-b1fb-4445-a92f-8860154b9e2d Jun 30 18:45:05.237066 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:45:05.237066 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-b3f5c11b-d8f3-4f5a-8c3d-88692a32ff2e tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Returning 400 to user: Invalid volume: volume 5edb046c-d8df-4685-abbb-f7d6deaaa81b is already attached to instances: ee34e802-b1fb-4445-a92f-8860154b9e2d {{(pid=117940) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:45:05.237066 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-b3f5c11b-d8f3-4f5a-8c3d-88692a32ff2e tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "POST /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.093416 Jun 30 18:45:05.237066 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 604/1216] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 30 18:45:05 2022] POST /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d/os-volume_attachments => generated 174 bytes in 94 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 30 18:45:05.300341 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-6eb26ae5-79e0-42d8-97bd-f5272db1f199 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:45:05.300954 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-6eb26ae5-79e0-42d8-97bd-f5272db1f199 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: ee34e802-b1fb-4445-a92f-8860154b9e2d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:05.308259 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6eb26ae5-79e0-42d8-97bd-f5272db1f199 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:05.308705 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6eb26ae5-79e0-42d8-97bd-f5272db1f199 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:05.309479 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6eb26ae5-79e0-42d8-97bd-f5272db1f199 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:05.309963 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6eb26ae5-79e0-42d8-97bd-f5272db1f199 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:05.388858 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.objects.instance [None req-6eb26ae5-79e0-42d8-97bd-f5272db1f199 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lazy-loading 'services' on Instance uuid ee34e802-b1fb-4445-a92f-8860154b9e2d {{(pid=117941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 18:45:05.460439 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-6eb26ae5-79e0-42d8-97bd-f5272db1f199 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d/os-volume_attachments/5edb046c-d8df-4685-abbb-f7d6deaaa81b" status: 202 len: 0 microversion: 2.1 time: 0.164237 Jun 30 18:45:05.461779 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 613/1217] 10.222.0.33 () {58 vars in 1415 bytes} [Thu Jun 30 18:45:05 2022] DELETE /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d/os-volume_attachments/5edb046c-d8df-4685-abbb-f7d6deaaa81b => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 18:45:05.469976 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-44dc37f7-0801-4562-b0f2-8286255baac1 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:45:05.470899 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-44dc37f7-0801-4562-b0f2-8286255baac1 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: ee34e802-b1fb-4445-a92f-8860154b9e2d] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:05.477746 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-44dc37f7-0801-4562-b0f2-8286255baac1 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:05.478238 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-44dc37f7-0801-4562-b0f2-8286255baac1 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:05.479043 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-44dc37f7-0801-4562-b0f2-8286255baac1 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:05.479482 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-44dc37f7-0801-4562-b0f2-8286255baac1 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:05.509246 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-44dc37f7-0801-4562-b0f2-8286255baac1 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042800 Jun 30 18:45:05.509857 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 605/1218] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 30 18:45:05 2022] GET /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:45:06.521914 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-011d7b5f-1a6e-4e80-855e-140980731a45 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:45:06.522972 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-011d7b5f-1a6e-4e80-855e-140980731a45 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: ee34e802-b1fb-4445-a92f-8860154b9e2d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:06.529941 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-011d7b5f-1a6e-4e80-855e-140980731a45 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:06.530382 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-011d7b5f-1a6e-4e80-855e-140980731a45 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:06.531133 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-011d7b5f-1a6e-4e80-855e-140980731a45 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:06.531565 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-011d7b5f-1a6e-4e80-855e-140980731a45 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:06.560660 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-011d7b5f-1a6e-4e80-855e-140980731a45 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043587 Jun 30 18:45:06.561204 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 614/1219] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 30 18:45:06 2022] GET /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 18:45:06.620597 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-5e32816f-724f-4d50-82a0-3e428caf6fda tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:45:06.621119 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-5e32816f-724f-4d50-82a0-3e428caf6fda tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: ee34e802-b1fb-4445-a92f-8860154b9e2d] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:06.627838 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5e32816f-724f-4d50-82a0-3e428caf6fda tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:06.628279 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5e32816f-724f-4d50-82a0-3e428caf6fda tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:06.629044 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5e32816f-724f-4d50-82a0-3e428caf6fda tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:06.629479 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5e32816f-724f-4d50-82a0-3e428caf6fda tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:06.665250 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-5e32816f-724f-4d50-82a0-3e428caf6fda tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: ee34e802-b1fb-4445-a92f-8860154b9e2d] Going to try to terminate instance {{(pid=117940) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 18:45:06.740129 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-5e32816f-724f-4d50-82a0-3e428caf6fda tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d" status: 204 len: 0 microversion: 2.1 time: 0.123219 Jun 30 18:45:06.740745 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 606/1220] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 30 18:45:06 2022] DELETE /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 18:45:06.749039 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-f5b9acff-1c09-4b28-95a0-bb993eab0743 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:45:06.749679 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-f5b9acff-1c09-4b28-95a0-bb993eab0743 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: ee34e802-b1fb-4445-a92f-8860154b9e2d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:06.756752 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f5b9acff-1c09-4b28-95a0-bb993eab0743 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:06.757200 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f5b9acff-1c09-4b28-95a0-bb993eab0743 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:06.758604 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f5b9acff-1c09-4b28-95a0-bb993eab0743 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:06.759038 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-f5b9acff-1c09-4b28-95a0-bb993eab0743 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:06.892462 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-f5b9acff-1c09-4b28-95a0-bb993eab0743 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:45:06.900380 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-f5b9acff-1c09-4b28-95a0-bb993eab0743 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d" status: 200 len: 1679 microversion: 2.1 time: 0.155160 Jun 30 18:45:06.900941 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 615/1221] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:45:06 2022] GET /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:45:07.918963 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-67242a8a-615c-417e-ab32-4a83a5dfb5bf tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:45:07.919879 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-67242a8a-615c-417e-ab32-4a83a5dfb5bf tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: ee34e802-b1fb-4445-a92f-8860154b9e2d] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:07.926263 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-67242a8a-615c-417e-ab32-4a83a5dfb5bf tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:07.926718 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-67242a8a-615c-417e-ab32-4a83a5dfb5bf tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:07.927475 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-67242a8a-615c-417e-ab32-4a83a5dfb5bf tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:07.927908 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-67242a8a-615c-417e-ab32-4a83a5dfb5bf tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:07.975500 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-580ee6d3-56e2-4797-a370-161de2c45684 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:45:07.976111 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-580ee6d3-56e2-4797-a370-161de2c45684 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:07.983429 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-580ee6d3-56e2-4797-a370-161de2c45684 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:07.983879 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-580ee6d3-56e2-4797-a370-161de2c45684 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:07.984634 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-580ee6d3-56e2-4797-a370-161de2c45684 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:07.985065 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-580ee6d3-56e2-4797-a370-161de2c45684 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:08.007586 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.objects.instance [None req-580ee6d3-56e2-4797-a370-161de2c45684 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lazy-loading 'flavor' on Instance uuid e521acf7-4c22-4f2f-9014-0fe2b98e5177 {{(pid=117941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 18:45:08.059405 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-67242a8a-615c-417e-ab32-4a83a5dfb5bf tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:45:08.067786 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-67242a8a-615c-417e-ab32-4a83a5dfb5bf tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d" status: 200 len: 1679 microversion: 2.1 time: 0.153729 Jun 30 18:45:08.068683 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 607/1222] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:45:07 2022] GET /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:45:08.082063 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-580ee6d3-56e2-4797-a370-161de2c45684 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "POST /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177/action" status: 202 len: 0 microversion: 2.1 time: 0.110232 Jun 30 18:45:08.082651 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 616/1223] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 30 18:45:07 2022] POST /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 30 18:45:08.092306 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-9bb4669e-d97e-431e-a8d1-454e64b94f7c tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:45:08.092926 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-9bb4669e-d97e-431e-a8d1-454e64b94f7c tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:08.098929 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9bb4669e-d97e-431e-a8d1-454e64b94f7c tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:08.099453 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9bb4669e-d97e-431e-a8d1-454e64b94f7c tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:08.100335 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9bb4669e-d97e-431e-a8d1-454e64b94f7c tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:08.100856 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9bb4669e-d97e-431e-a8d1-454e64b94f7c tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:08.237115 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-9bb4669e-d97e-431e-a8d1-454e64b94f7c tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f4e45a0882410088464b550a4b06c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc355242c9d490d91fbcbd7d08f8b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:45:08.244826 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-9bb4669e-d97e-431e-a8d1-454e64b94f7c tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177" status: 200 len: 1568 microversion: 2.1 time: 0.157340 Jun 30 18:45:08.245391 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 608/1224] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:45:08 2022] GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:45:09.087176 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-6b5c4bb8-c7a8-460d-b238-3d87c0562ca5 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:45:09.087922 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-6b5c4bb8-c7a8-460d-b238-3d87c0562ca5 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: ee34e802-b1fb-4445-a92f-8860154b9e2d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:09.094335 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6b5c4bb8-c7a8-460d-b238-3d87c0562ca5 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:09.094786 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6b5c4bb8-c7a8-460d-b238-3d87c0562ca5 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:09.095520 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6b5c4bb8-c7a8-460d-b238-3d87c0562ca5 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:09.095944 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-6b5c4bb8-c7a8-460d-b238-3d87c0562ca5 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:09.261862 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-801a0269-708e-4384-bed7-825ace1ccd8a tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:45:09.262580 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-801a0269-708e-4384-bed7-825ace1ccd8a tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:09.269088 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-801a0269-708e-4384-bed7-825ace1ccd8a tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:09.269559 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-801a0269-708e-4384-bed7-825ace1ccd8a tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:09.270342 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-801a0269-708e-4384-bed7-825ace1ccd8a tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:09.270803 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-801a0269-708e-4384-bed7-825ace1ccd8a tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:09.390356 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-6b5c4bb8-c7a8-460d-b238-3d87c0562ca5 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:45:09.397887 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-6b5c4bb8-c7a8-460d-b238-3d87c0562ca5 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d" status: 200 len: 1679 microversion: 2.1 time: 0.316260 Jun 30 18:45:09.405669 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 617/1225] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:45:09 2022] GET /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d => generated 1679 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:45:09.468302 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-801a0269-708e-4384-bed7-825ace1ccd8a tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f4e45a0882410088464b550a4b06c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc355242c9d490d91fbcbd7d08f8b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:45:09.475876 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-801a0269-708e-4384-bed7-825ace1ccd8a tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177" status: 200 len: 1568 microversion: 2.1 time: 0.217782 Jun 30 18:45:09.476374 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 609/1226] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:45:09 2022] GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177 => generated 1568 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:45:09.641201 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-062e1185-982b-4c48-87f9-6b0a792008d1 req-6c63fabf-1715-4b20-8202-9f5b88a7566b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee34e802-b1fb-4445-a92f-8860154b9e2d", "name": "network-vif-deleted", "tag": "44b86c8d-2449-4cbd-b49a-36ec9c0aaa4b"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:45:09.650725 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-062e1185-982b-4c48-87f9-6b0a792008d1 req-6c63fabf-1715-4b20-8202-9f5b88a7566b service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:09.651255 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-062e1185-982b-4c48-87f9-6b0a792008d1 req-6c63fabf-1715-4b20-8202-9f5b88a7566b service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:09.668778 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.compute.server_external_events [req-062e1185-982b-4c48-87f9-6b0a792008d1 req-6c63fabf-1715-4b20-8202-9f5b88a7566b service nova] Creating event network-vif-deleted:44b86c8d-2449-4cbd-b49a-36ec9c0aaa4b for instance ee34e802-b1fb-4445-a92f-8860154b9e2d on hv-cinder-80378 Jun 30 18:45:09.678356 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-062e1185-982b-4c48-87f9-6b0a792008d1 req-6c63fabf-1715-4b20-8202-9f5b88a7566b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040236 Jun 30 18:45:09.680087 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 618/1227] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:45:10.415814 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-dcf0675c-5d94-456b-a477-a8d78a6f3c69 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:45:10.416424 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-dcf0675c-5d94-456b-a477-a8d78a6f3c69 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: ee34e802-b1fb-4445-a92f-8860154b9e2d] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:10.423346 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-dcf0675c-5d94-456b-a477-a8d78a6f3c69 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:10.423804 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-dcf0675c-5d94-456b-a477-a8d78a6f3c69 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:10.424581 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-dcf0675c-5d94-456b-a477-a8d78a6f3c69 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:10.425015 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-dcf0675c-5d94-456b-a477-a8d78a6f3c69 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:10.439528 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.wsgi [None req-dcf0675c-5d94-456b-a477-a8d78a6f3c69 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] HTTP exception thrown: Instance ee34e802-b1fb-4445-a92f-8860154b9e2d could not be found. Jun 30 18:45:10.441173 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-dcf0675c-5d94-456b-a477-a8d78a6f3c69 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Request method failure captured: Jun 30 18:45:10.441173 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: request: GET /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d HTTP/1.1 Jun 30 18:45:10.441173 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept: application/json Jun 30 18:45:10.441173 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept-Encoding: identity Jun 30 18:45:10.441173 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Connection: close Jun 30 18:45:10.441173 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Length: 0 Jun 30 18:45:10.441173 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Type: application/json Jun 30 18:45:10.441173 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Host: 10.222.0.33 Jun 30 18:45:10.441173 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Openstack-System-Scope: None Jun 30 18:45:10.441173 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: User-Agent: python-urllib3/1.26.9 Jun 30 18:45:10.441173 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Auth-Token: gAAAAABive3_mQ4kZ2JNveNggCM2j6Qam1PzZzze4niNBx_ABO6k3xVntyI41bCtbU1dqHi3AaxJKokcovO0E907Am7gbM4_Spd2N8jkkVzqboNWXgAyxs4i5CVIc1cpe4RDkM3IBciZBWXtbJ1cU6IuTIKWreKtjsnNHJNRFm0dFUHScNhmgkQ Jun 30 18:45:10.441173 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Id: None Jun 30 18:45:10.441173 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Name: None Jun 30 18:45:10.441173 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Identity-Status: Confirmed Jun 30 18:45:10.441173 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Is-Admin-Project: True Jun 30 18:45:10.441173 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Id: default Jun 30 18:45:10.441173 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Name: Default Jun 30 18:45:10.441173 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Id: b8227be3d9a044ed888b2f54abd9463d Jun 30 18:45:10.441173 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Name: tempest-AttachVolumeNegativeTest-1944998081 Jun 30 18:45:10.441173 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Role: reader,member Jun 30 18:45:10.441173 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Roles: reader,member Jun 30 18:45:10.442636 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b8227be3d9a044ed888b2f54abd9463d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b8227be3d9a044ed888b2f54abd9463d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b8227be3d9a044ed888b2f54abd9463d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b8227be3d9a044ed888b2f54abd9463d"}]}] Jun 30 18:45:10.442636 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant: tempest-AttachVolumeNegativeTest-1944998081 Jun 30 18:45:10.442636 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Id: b8227be3d9a044ed888b2f54abd9463d Jun 30 18:45:10.442636 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1944998081 Jun 30 18:45:10.442636 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User: tempest-AttachVolumeNegativeTest-1944998081-project Jun 30 18:45:10.442636 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Id: default Jun 30 18:45:10.442636 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Name: Default Jun 30 18:45:10.442636 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Id: 9531d18446eb4488bbd1511cb3412925 Jun 30 18:45:10.442636 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Name: tempest-AttachVolumeNegativeTest-1944998081-project Jun 30 18:45:10.442636 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: method: > Jun 30 18:45:10.442636 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: exception: Instance ee34e802-b1fb-4445-a92f-8860154b9e2d could not be found. Jun 30 18:45:10.442636 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: action_args: {'id': 'ee34e802-b1fb-4445-a92f-8860154b9e2d'} Jun 30 18:45:10.443612 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:45:10.443612 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:45:10.443612 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:45:10.443612 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:45:10.443612 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:45:10.443612 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:45:10.443612 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:45:10.443612 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:45:10.443612 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:45:10.443612 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:45:10.443612 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee34e802-b1fb-4445-a92f-8860154b9e2d could not be found. Jun 30 18:45:10.443612 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:45:10.443612 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:45:10.443612 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:45:10.443612 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:45:10.443612 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:45:10.443612 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:45:10.443612 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:45:10.443612 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:45:10.443612 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:45:10.445766 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:45:10.445766 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:45:10.445766 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:45:10.445766 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:45:10.445766 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:45:10.445766 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:45:10.445766 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:45:10.445766 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee34e802-b1fb-4445-a92f-8860154b9e2d could not be found. Jun 30 18:45:10.445766 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:45:10.445766 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:45:10.445766 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:45:10.445766 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:45:10.445766 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:45:10.445766 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:45:10.445766 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:45:10.445766 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:45:10.445766 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee34e802-b1fb-4445-a92f-8860154b9e2d could not be found. Jun 30 18:45:10.445766 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:45:10.446962 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-dcf0675c-5d94-456b-a477-a8d78a6f3c69 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Returning 404 to user: Instance ee34e802-b1fb-4445-a92f-8860154b9e2d could not be found. {{(pid=117940) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:45:10.446962 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-dcf0675c-5d94-456b-a477-a8d78a6f3c69 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d" status: 404 len: 111 microversion: 2.1 time: 0.030970 Jun 30 18:45:10.446962 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 610/1228] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:45:10 2022] GET /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:45:10.453816 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-837cfc47-b3d4-473b-8243-91556eedf81c tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '.version_select at 0x7f1804d83dc0>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:45:10.472505 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-837cfc47-b3d4-473b-8243-91556eedf81c tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-909220423" status: 202 len: 0 microversion: 2.1 time: 0.023265 Jun 30 18:45:10.473291 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 619/1229] 10.222.0.33 () {58 vars in 1217 bytes} [Thu Jun 30 18:45:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-909220423 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 18:45:10.493798 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-20809e22-4f03-4465-8692-7e625143ab25 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:45:10.494539 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-20809e22-4f03-4465-8692-7e625143ab25 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:10.501515 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-20809e22-4f03-4465-8692-7e625143ab25 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:10.502063 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-20809e22-4f03-4465-8692-7e625143ab25 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:10.502920 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-20809e22-4f03-4465-8692-7e625143ab25 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:10.503423 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-20809e22-4f03-4465-8692-7e625143ab25 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:10.697311 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-20809e22-4f03-4465-8692-7e625143ab25 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f4e45a0882410088464b550a4b06c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc355242c9d490d91fbcbd7d08f8b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:45:10.705212 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-20809e22-4f03-4465-8692-7e625143ab25 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177" status: 200 len: 1568 microversion: 2.1 time: 0.216854 Jun 30 18:45:10.705827 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 611/1230] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:45:10 2022] GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177 => generated 1568 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:45:11.203576 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-58d77997-8c2d-447d-ba1d-e870d63a9db6 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Action: 'create', calling method: .version_select at 0x7f1804e1ee50>, body: {"keypair": {"name": "tempest-keypair-1413659994", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjDm+JRCru9rYQNH2fYN7rrTMlwNCXK6wl7CPKKARkS5ebuFgMDxixv+tA3ZEHWqPnMEx2zZruZjOmFKebimVUSVLfS2FHZf4g8d3I/JcaJllv+vs3b+YDbxmab8o6lvA=="}} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:45:11.218159 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.quota [None req-58d77997-8c2d-447d-ba1d-e870d63a9db6 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Getting quotas for project b8227be3d9a044ed888b2f54abd9463d. Resources: {'key_pairs'} {{(pid=117941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 18:45:11.222239 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.quota [None req-58d77997-8c2d-447d-ba1d-e870d63a9db6 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Getting quotas for user 9531d18446eb4488bbd1511cb3412925 and project b8227be3d9a044ed888b2f54abd9463d. Resources: {'key_pairs'} {{(pid=117941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 18:45:11.243884 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-58d77997-8c2d-447d-ba1d-e870d63a9db6 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044472 Jun 30 18:45:11.244492 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 620/1231] 10.222.0.33 () {60 vars in 1158 bytes} [Thu Jun 30 18:45:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:45:11.722374 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-da5d1bae-c054-4f40-8db8-ce4ccdf7a4ee tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:45:11.723001 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-da5d1bae-c054-4f40-8db8-ce4ccdf7a4ee tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:11.730947 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-da5d1bae-c054-4f40-8db8-ce4ccdf7a4ee tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:11.731396 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-da5d1bae-c054-4f40-8db8-ce4ccdf7a4ee tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:11.732157 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-da5d1bae-c054-4f40-8db8-ce4ccdf7a4ee tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:11.732587 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-da5d1bae-c054-4f40-8db8-ce4ccdf7a4ee tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:11.940868 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-da5d1bae-c054-4f40-8db8-ce4ccdf7a4ee tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f4e45a0882410088464b550a4b06c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc355242c9d490d91fbcbd7d08f8b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:45:11.949559 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-da5d1bae-c054-4f40-8db8-ce4ccdf7a4ee tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177" status: 200 len: 1568 microversion: 2.1 time: 0.230994 Jun 30 18:45:11.950160 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 612/1232] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:45:11 2022] GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177 => generated 1568 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:45:12.547901 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-a081e4cc-254a-4a07-8f37-f4c168d01744 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1191686301", "imageRef": "636d6d52-5033-47e1-bf75-0b4fc50c0bb0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c75ba402-1254-4901-ad58-40e30172cc26"}], "security_groups": [{"name": "tempest-securitygroup--159016956"}], "key_name": "tempest-keypair-1413659994", "user_data": "}} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:45:12.655938 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.network.neutron [None req-a081e4cc-254a-4a07-8f37-f4c168d01744 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] validate_networks() for [('c75ba402-1254-4901-ad58-40e30172cc26', None, None, None, None, None)] {{(pid=117941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 18:45:12.966418 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-b05eccd5-b370-4a39-b524-3b2cb6f97e63 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:45:12.967093 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-b05eccd5-b370-4a39-b524-3b2cb6f97e63 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:12.973453 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b05eccd5-b370-4a39-b524-3b2cb6f97e63 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:12.973911 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b05eccd5-b370-4a39-b524-3b2cb6f97e63 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:12.974654 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b05eccd5-b370-4a39-b524-3b2cb6f97e63 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:12.975077 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b05eccd5-b370-4a39-b524-3b2cb6f97e63 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:13.081049 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.virt.hardware [None req-a081e4cc-254a-4a07-8f37-f4c168d01744 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Flavor limits 0:0:0 {{(pid=117941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 18:45:13.081663 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.virt.hardware [None req-a081e4cc-254a-4a07-8f37-f4c168d01744 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Image limits 0:0:0 {{(pid=117941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 18:45:13.082150 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.virt.hardware [None req-a081e4cc-254a-4a07-8f37-f4c168d01744 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Flavor pref 0:0:0 {{(pid=117941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 18:45:13.082684 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.virt.hardware [None req-a081e4cc-254a-4a07-8f37-f4c168d01744 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Image pref 0:0:0 {{(pid=117941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 18:45:13.083158 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.virt.hardware [None req-a081e4cc-254a-4a07-8f37-f4c168d01744 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 18:45:13.093880 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a081e4cc-254a-4a07-8f37-f4c168d01744 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:13.094353 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a081e4cc-254a-4a07-8f37-f4c168d01744 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:13.095149 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a081e4cc-254a-4a07-8f37-f4c168d01744 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:13.095586 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a081e4cc-254a-4a07-8f37-f4c168d01744 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:13.112915 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.quota [None req-a081e4cc-254a-4a07-8f37-f4c168d01744 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Getting quotas for project b8227be3d9a044ed888b2f54abd9463d. Resources: {'ram', 'instances', 'cores'} {{(pid=117941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 18:45:13.116939 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.quota [None req-a081e4cc-254a-4a07-8f37-f4c168d01744 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Getting quotas for user 9531d18446eb4488bbd1511cb3412925 and project b8227be3d9a044ed888b2f54abd9463d. Resources: {'ram', 'instances', 'cores'} {{(pid=117941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 18:45:13.128175 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-a081e4cc-254a-4a07-8f37-f4c168d01744 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Going to run 1 instances... {{(pid=117941) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 18:45:13.130173 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-b05eccd5-b370-4a39-b524-3b2cb6f97e63 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f4e45a0882410088464b550a4b06c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc355242c9d490d91fbcbd7d08f8b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:45:13.130562 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-a081e4cc-254a-4a07-8f37-f4c168d01744 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 0580042d-65ab-4b3f-9ab5-15464bb95ac1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='636d6d52-5033-47e1-bf75-0b4fc50c0bb0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 18:45:13.138102 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-b05eccd5-b370-4a39-b524-3b2cb6f97e63 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177" status: 200 len: 1568 microversion: 2.1 time: 0.175475 Jun 30 18:45:13.138745 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 613/1233] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:45:12 2022] GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:45:13.176932 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a081e4cc-254a-4a07-8f37-f4c168d01744 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [03c47758-59ec-4656-b4f3-2b39d4cb69b9] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 30 18:45:14.155245 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-f57b3091-f501-439e-96ff-ec80f102ad57 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:45:14.155858 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-f57b3091-f501-439e-96ff-ec80f102ad57 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:14.162584 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f57b3091-f501-439e-96ff-ec80f102ad57 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:14.163031 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f57b3091-f501-439e-96ff-ec80f102ad57 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:14.164272 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f57b3091-f501-439e-96ff-ec80f102ad57 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:14.164709 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f57b3091-f501-439e-96ff-ec80f102ad57 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:14.185052 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO oslo.messaging._drivers.impl_rabbit [None req-a081e4cc-254a-4a07-8f37-f4c168d01744 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [03c47758-59ec-4656-b4f3-2b39d4cb69b9] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 45854. Jun 30 18:45:14.189232 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-a081e4cc-254a-4a07-8f37-f4c168d01744 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.645891 Jun 30 18:45:14.195860 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 621/1234] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 30 18:45:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 1648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 18:45:14.200906 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-a0d67564-e688-4bb6-8148-d062bf503084 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:45:14.201686 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-a0d67564-e688-4bb6-8148-d062bf503084 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 0580042d-65ab-4b3f-9ab5-15464bb95ac1] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:14.266059 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-a0d67564-e688-4bb6-8148-d062bf503084 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:45:14.272935 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-a0d67564-e688-4bb6-8148-d062bf503084 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1" status: 200 len: 1242 microversion: 2.1 time: 0.075607 Jun 30 18:45:14.273598 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 622/1235] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:45:14 2022] GET /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1 => generated 1242 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:45:14.327709 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-f57b3091-f501-439e-96ff-ec80f102ad57 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f4e45a0882410088464b550a4b06c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc355242c9d490d91fbcbd7d08f8b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:45:14.335078 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-f57b3091-f501-439e-96ff-ec80f102ad57 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177" status: 200 len: 1568 microversion: 2.1 time: 0.183728 Jun 30 18:45:14.335752 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 614/1236] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:45:14 2022] GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177 => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:45:15.290012 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-866bfbd5-bd4c-40c4-aa84-d131761d3d22 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:45:15.290523 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-866bfbd5-bd4c-40c4-aa84-d131761d3d22 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 0580042d-65ab-4b3f-9ab5-15464bb95ac1] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:15.348811 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-866bfbd5-bd4c-40c4-aa84-d131761d3d22 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:45:15.352837 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-c7f86eb5-584f-4951-b37d-be07f10aefd8 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:45:15.353529 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-c7f86eb5-584f-4951-b37d-be07f10aefd8 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:15.356174 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-866bfbd5-bd4c-40c4-aa84-d131761d3d22 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1" status: 200 len: 1242 microversion: 2.1 time: 0.070167 Jun 30 18:45:15.357110 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 623/1237] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:45:15 2022] GET /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1 => generated 1242 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:45:15.369154 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c7f86eb5-584f-4951-b37d-be07f10aefd8 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:15.369624 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c7f86eb5-584f-4951-b37d-be07f10aefd8 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:15.370395 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c7f86eb5-584f-4951-b37d-be07f10aefd8 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:15.370840 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c7f86eb5-584f-4951-b37d-be07f10aefd8 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:15.505061 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-c7f86eb5-584f-4951-b37d-be07f10aefd8 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f4e45a0882410088464b550a4b06c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc355242c9d490d91fbcbd7d08f8b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:45:15.513729 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-c7f86eb5-584f-4951-b37d-be07f10aefd8 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177" status: 200 len: 1568 microversion: 2.1 time: 0.164802 Jun 30 18:45:15.514528 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 615/1238] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:45:15 2022] GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:45:16.373262 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-0a1d8e3a-4e61-4568-ab9b-1f86cbb2f7c8 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:45:16.373910 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-0a1d8e3a-4e61-4568-ab9b-1f86cbb2f7c8 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 0580042d-65ab-4b3f-9ab5-15464bb95ac1] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:16.381136 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0a1d8e3a-4e61-4568-ab9b-1f86cbb2f7c8 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:16.381586 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0a1d8e3a-4e61-4568-ab9b-1f86cbb2f7c8 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:16.382386 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0a1d8e3a-4e61-4568-ab9b-1f86cbb2f7c8 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:16.382808 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0a1d8e3a-4e61-4568-ab9b-1f86cbb2f7c8 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:16.443606 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-0a1d8e3a-4e61-4568-ab9b-1f86cbb2f7c8 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:45:16.451001 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-0a1d8e3a-4e61-4568-ab9b-1f86cbb2f7c8 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1" status: 200 len: 1246 microversion: 2.1 time: 0.081681 Jun 30 18:45:16.451556 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 624/1239] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:45:16 2022] GET /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1 => generated 1246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:45:16.530662 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-c185e7ec-5cef-4f03-a8f4-d17ca4a3f858 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:45:16.531266 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-c185e7ec-5cef-4f03-a8f4-d17ca4a3f858 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:16.537569 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c185e7ec-5cef-4f03-a8f4-d17ca4a3f858 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:16.538031 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c185e7ec-5cef-4f03-a8f4-d17ca4a3f858 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:16.538884 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c185e7ec-5cef-4f03-a8f4-d17ca4a3f858 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:16.539316 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c185e7ec-5cef-4f03-a8f4-d17ca4a3f858 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:16.671218 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-c185e7ec-5cef-4f03-a8f4-d17ca4a3f858 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f4e45a0882410088464b550a4b06c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc355242c9d490d91fbcbd7d08f8b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:45:16.678690 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-c185e7ec-5cef-4f03-a8f4-d17ca4a3f858 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177" status: 200 len: 1568 microversion: 2.1 time: 0.151763 Jun 30 18:45:16.679325 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 616/1240] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:45:16 2022] GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:45:17.467594 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-992c4c75-d86c-46dd-8c40-d7c2494b5772 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:45:17.468202 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-992c4c75-d86c-46dd-8c40-d7c2494b5772 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 0580042d-65ab-4b3f-9ab5-15464bb95ac1] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:17.475061 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-992c4c75-d86c-46dd-8c40-d7c2494b5772 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:17.475510 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-992c4c75-d86c-46dd-8c40-d7c2494b5772 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:17.476775 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-992c4c75-d86c-46dd-8c40-d7c2494b5772 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:17.477207 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-992c4c75-d86c-46dd-8c40-d7c2494b5772 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:17.548217 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-992c4c75-d86c-46dd-8c40-d7c2494b5772 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:45:17.556214 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-992c4c75-d86c-46dd-8c40-d7c2494b5772 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1" status: 200 len: 1300 microversion: 2.1 time: 0.092499 Jun 30 18:45:17.556789 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 625/1241] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:45:17 2022] GET /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1 => generated 1300 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:45:17.695913 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-9f7fa094-30aa-407f-82d3-7b0fc07bfbff tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:45:17.696537 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-9f7fa094-30aa-407f-82d3-7b0fc07bfbff tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:17.703137 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9f7fa094-30aa-407f-82d3-7b0fc07bfbff tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:17.703589 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9f7fa094-30aa-407f-82d3-7b0fc07bfbff tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:17.704350 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9f7fa094-30aa-407f-82d3-7b0fc07bfbff tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:17.704784 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9f7fa094-30aa-407f-82d3-7b0fc07bfbff tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:17.926132 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-9f7fa094-30aa-407f-82d3-7b0fc07bfbff tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f4e45a0882410088464b550a4b06c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc355242c9d490d91fbcbd7d08f8b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:45:17.933863 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-9f7fa094-30aa-407f-82d3-7b0fc07bfbff tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177" status: 200 len: 1568 microversion: 2.1 time: 0.241795 Jun 30 18:45:17.934431 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 617/1242] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:45:17 2022] GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177 => generated 1568 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:45:18.572737 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-3f850128-c732-449b-8977-021f920cecc4 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:45:18.574167 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-3f850128-c732-449b-8977-021f920cecc4 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 0580042d-65ab-4b3f-9ab5-15464bb95ac1] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:18.582971 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3f850128-c732-449b-8977-021f920cecc4 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:18.583415 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3f850128-c732-449b-8977-021f920cecc4 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:18.584406 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3f850128-c732-449b-8977-021f920cecc4 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:18.585553 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3f850128-c732-449b-8977-021f920cecc4 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:18.951440 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-f33befd4-945a-402b-8b60-7930c0a66e03 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:45:18.952188 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-f33befd4-945a-402b-8b60-7930c0a66e03 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:18.958837 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f33befd4-945a-402b-8b60-7930c0a66e03 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:18.959284 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f33befd4-945a-402b-8b60-7930c0a66e03 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:18.960079 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f33befd4-945a-402b-8b60-7930c0a66e03 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:18.960514 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f33befd4-945a-402b-8b60-7930c0a66e03 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:19.133876 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-3f850128-c732-449b-8977-021f920cecc4 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:45:19.141835 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-3f850128-c732-449b-8977-021f920cecc4 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1" status: 200 len: 1367 microversion: 2.1 time: 0.572856 Jun 30 18:45:19.142589 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 626/1243] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:45:18 2022] GET /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1 => generated 1367 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:45:19.235645 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-f33befd4-945a-402b-8b60-7930c0a66e03 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f4e45a0882410088464b550a4b06c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc355242c9d490d91fbcbd7d08f8b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:45:19.239391 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:45:19.245641 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-f33befd4-945a-402b-8b60-7930c0a66e03 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177" status: 200 len: 1568 microversion: 2.1 time: 0.298073 Jun 30 18:45:19.246672 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 618/1244] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:45:18 2022] GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177 => generated 1568 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:45:19.318408 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-da935c39-a446-4a75-8a9e-377fa6e8d804 req-d62b2898-cad8-44e6-ab30-7a1578503698 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0580042d-65ab-4b3f-9ab5-15464bb95ac1", "tag": "04598684-b276-472a-9961-96c41c95ca61"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:45:19.327021 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-da935c39-a446-4a75-8a9e-377fa6e8d804 req-d62b2898-cad8-44e6-ab30-7a1578503698 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:19.327461 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-da935c39-a446-4a75-8a9e-377fa6e8d804 req-d62b2898-cad8-44e6-ab30-7a1578503698 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:19.339371 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.compute.server_external_events [req-da935c39-a446-4a75-8a9e-377fa6e8d804 req-d62b2898-cad8-44e6-ab30-7a1578503698 service nova] Creating event network-changed:04598684-b276-472a-9961-96c41c95ca61 for instance 0580042d-65ab-4b3f-9ab5-15464bb95ac1 on hv-cinder-80378 Jun 30 18:45:19.344517 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-da935c39-a446-4a75-8a9e-377fa6e8d804 req-d62b2898-cad8-44e6-ab30-7a1578503698 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105315 Jun 30 18:45:19.345171 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 627/1245] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:45:20.159256 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-2f34f794-ec2e-4e49-8084-38d947e46a76 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:45:20.160072 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-2f34f794-ec2e-4e49-8084-38d947e46a76 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 0580042d-65ab-4b3f-9ab5-15464bb95ac1] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:20.167239 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-2f34f794-ec2e-4e49-8084-38d947e46a76 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:20.167675 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-2f34f794-ec2e-4e49-8084-38d947e46a76 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:20.168434 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-2f34f794-ec2e-4e49-8084-38d947e46a76 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:20.168859 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-2f34f794-ec2e-4e49-8084-38d947e46a76 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:20.267279 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-84d6a9e9-0898-4118-9a29-a5606b6fde40 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:45:20.268089 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-84d6a9e9-0898-4118-9a29-a5606b6fde40 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:20.275930 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-84d6a9e9-0898-4118-9a29-a5606b6fde40 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:20.276461 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-84d6a9e9-0898-4118-9a29-a5606b6fde40 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:20.277284 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-84d6a9e9-0898-4118-9a29-a5606b6fde40 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:20.277720 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-84d6a9e9-0898-4118-9a29-a5606b6fde40 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:20.311290 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-2f34f794-ec2e-4e49-8084-38d947e46a76 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:45:20.318620 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-2f34f794-ec2e-4e49-8084-38d947e46a76 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1" status: 200 len: 1367 microversion: 2.1 time: 0.163575 Jun 30 18:45:20.320004 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 619/1246] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:45:20 2022] GET /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:45:20.478514 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-84d6a9e9-0898-4118-9a29-a5606b6fde40 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f4e45a0882410088464b550a4b06c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc355242c9d490d91fbcbd7d08f8b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:45:20.487641 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-84d6a9e9-0898-4118-9a29-a5606b6fde40 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177" status: 200 len: 1568 microversion: 2.1 time: 0.223637 Jun 30 18:45:20.488261 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 628/1247] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:45:20 2022] GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177 => generated 1568 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:45:21.336843 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-1e959ddb-fa05-4609-b460-6d3f9dc02ca8 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:45:21.337423 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-1e959ddb-fa05-4609-b460-6d3f9dc02ca8 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 0580042d-65ab-4b3f-9ab5-15464bb95ac1] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:21.343797 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-1e959ddb-fa05-4609-b460-6d3f9dc02ca8 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:21.344240 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-1e959ddb-fa05-4609-b460-6d3f9dc02ca8 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:21.344997 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-1e959ddb-fa05-4609-b460-6d3f9dc02ca8 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:21.345428 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-1e959ddb-fa05-4609-b460-6d3f9dc02ca8 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:21.474259 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-1e959ddb-fa05-4609-b460-6d3f9dc02ca8 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:45:21.482207 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-1e959ddb-fa05-4609-b460-6d3f9dc02ca8 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1" status: 200 len: 1367 microversion: 2.1 time: 0.149959 Jun 30 18:45:21.482774 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 620/1248] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:45:21 2022] GET /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:45:21.504242 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-a10bb81e-d58a-4eae-8f1a-68c3472a5a85 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:45:21.504846 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-a10bb81e-d58a-4eae-8f1a-68c3472a5a85 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:21.511487 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a10bb81e-d58a-4eae-8f1a-68c3472a5a85 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:21.511922 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a10bb81e-d58a-4eae-8f1a-68c3472a5a85 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:21.512669 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a10bb81e-d58a-4eae-8f1a-68c3472a5a85 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:21.513100 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a10bb81e-d58a-4eae-8f1a-68c3472a5a85 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:21.644686 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-a10bb81e-d58a-4eae-8f1a-68c3472a5a85 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f4e45a0882410088464b550a4b06c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc355242c9d490d91fbcbd7d08f8b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:45:21.652765 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-a10bb81e-d58a-4eae-8f1a-68c3472a5a85 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177" status: 200 len: 1509 microversion: 2.1 time: 0.152294 Jun 30 18:45:21.653338 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 629/1249] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:45:21 2022] GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177 => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:45:21.674519 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-8ae886af-3ffb-46bd-9d13-578cef4dbfff tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:45:21.675294 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-8ae886af-3ffb-46bd-9d13-578cef4dbfff tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:21.681875 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8ae886af-3ffb-46bd-9d13-578cef4dbfff tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:21.682317 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8ae886af-3ffb-46bd-9d13-578cef4dbfff tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:21.683425 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8ae886af-3ffb-46bd-9d13-578cef4dbfff tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:21.684017 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-8ae886af-3ffb-46bd-9d13-578cef4dbfff tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:21.813127 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-8ae886af-3ffb-46bd-9d13-578cef4dbfff tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "POST /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177/action" status: 202 len: 0 microversion: 2.1 time: 0.146832 Jun 30 18:45:21.813759 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 621/1250] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 30 18:45:21 2022] POST /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 18:45:21.822474 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-db6659b3-862d-455e-8bd2-800fe5a999e2 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:45:21.823083 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-db6659b3-862d-455e-8bd2-800fe5a999e2 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:21.828952 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-db6659b3-862d-455e-8bd2-800fe5a999e2 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:21.829401 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-db6659b3-862d-455e-8bd2-800fe5a999e2 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:21.830197 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-db6659b3-862d-455e-8bd2-800fe5a999e2 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:21.830626 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-db6659b3-862d-455e-8bd2-800fe5a999e2 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:21.853267 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:45:21.974979 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-db6659b3-862d-455e-8bd2-800fe5a999e2 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f4e45a0882410088464b550a4b06c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc355242c9d490d91fbcbd7d08f8b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:45:21.983164 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-db6659b3-862d-455e-8bd2-800fe5a999e2 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177" status: 200 len: 1517 microversion: 2.1 time: 0.165266 Jun 30 18:45:21.983747 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 630/1251] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:45:21 2022] GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177 => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:45:22.499002 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-f7496f1e-ef7f-47b2-ba14-efe535a4d659 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:45:22.499619 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-f7496f1e-ef7f-47b2-ba14-efe535a4d659 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 0580042d-65ab-4b3f-9ab5-15464bb95ac1] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:22.505674 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f7496f1e-ef7f-47b2-ba14-efe535a4d659 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:22.506123 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f7496f1e-ef7f-47b2-ba14-efe535a4d659 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:22.506896 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f7496f1e-ef7f-47b2-ba14-efe535a4d659 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:22.507436 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-f7496f1e-ef7f-47b2-ba14-efe535a4d659 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:22.635312 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-f7496f1e-ef7f-47b2-ba14-efe535a4d659 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:45:22.642848 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-f7496f1e-ef7f-47b2-ba14-efe535a4d659 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1" status: 200 len: 1367 microversion: 2.1 time: 0.148140 Jun 30 18:45:22.643440 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 622/1252] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:45:22 2022] GET /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:45:23.000245 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-fe9b7b5f-8fe4-44cc-aa6a-d4f940e38a5b tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:45:23.000873 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-fe9b7b5f-8fe4-44cc-aa6a-d4f940e38a5b tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:23.007350 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fe9b7b5f-8fe4-44cc-aa6a-d4f940e38a5b tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:23.007784 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fe9b7b5f-8fe4-44cc-aa6a-d4f940e38a5b tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:23.008524 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fe9b7b5f-8fe4-44cc-aa6a-d4f940e38a5b tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:23.008947 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-fe9b7b5f-8fe4-44cc-aa6a-d4f940e38a5b tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:23.103132 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell0:SELECT=2 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:45:23.144450 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-fe9b7b5f-8fe4-44cc-aa6a-d4f940e38a5b tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f4e45a0882410088464b550a4b06c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc355242c9d490d91fbcbd7d08f8b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:45:23.152351 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-fe9b7b5f-8fe4-44cc-aa6a-d4f940e38a5b tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177" status: 200 len: 1517 microversion: 2.1 time: 0.155993 Jun 30 18:45:23.152900 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 631/1253] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:45:22 2022] GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:45:23.660190 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-402c89fb-c977-4da9-b68a-e996c3686a14 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:45:23.661505 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-402c89fb-c977-4da9-b68a-e996c3686a14 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 0580042d-65ab-4b3f-9ab5-15464bb95ac1] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:23.669456 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-402c89fb-c977-4da9-b68a-e996c3686a14 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:23.670053 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-402c89fb-c977-4da9-b68a-e996c3686a14 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:23.670906 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-402c89fb-c977-4da9-b68a-e996c3686a14 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:23.671426 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-402c89fb-c977-4da9-b68a-e996c3686a14 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:23.824866 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-402c89fb-c977-4da9-b68a-e996c3686a14 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:45:23.833641 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-402c89fb-c977-4da9-b68a-e996c3686a14 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1" status: 200 len: 1367 microversion: 2.1 time: 0.177308 Jun 30 18:45:23.834488 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 623/1254] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:45:23 2022] GET /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:45:24.012097 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-c5a8b5af-89d0-4719-95ce-790d8a0676b8 req-482718aa-4c61-4e14-b263-cf49af4ea875 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e521acf7-4c22-4f2f-9014-0fe2b98e5177", "name": "network-vif-unplugged", "status": "completed", "tag": "2f35c8e5-f600-4e52-a4cb-3e624aeebaff"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:45:24.021206 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-c5a8b5af-89d0-4719-95ce-790d8a0676b8 req-482718aa-4c61-4e14-b263-cf49af4ea875 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:24.021751 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-c5a8b5af-89d0-4719-95ce-790d8a0676b8 req-482718aa-4c61-4e14-b263-cf49af4ea875 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:24.034256 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.compute.server_external_events [req-c5a8b5af-89d0-4719-95ce-790d8a0676b8 req-482718aa-4c61-4e14-b263-cf49af4ea875 service nova] Unable to find a host for instance e521acf7-4c22-4f2f-9014-0fe2b98e5177. Dropping event network-vif-unplugged {{(pid=117941) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 30 18:45:24.035213 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-c5a8b5af-89d0-4719-95ce-790d8a0676b8 req-482718aa-4c61-4e14-b263-cf49af4ea875 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.095382 Jun 30 18:45:24.036473 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 632/1255] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 97 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 30 18:45:24.170057 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-5762e50b-1f75-48a4-93b1-e3f6888dc8de tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:45:24.170687 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-5762e50b-1f75-48a4-93b1-e3f6888dc8de tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:24.176600 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5762e50b-1f75-48a4-93b1-e3f6888dc8de tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:24.177041 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5762e50b-1f75-48a4-93b1-e3f6888dc8de tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:24.177856 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5762e50b-1f75-48a4-93b1-e3f6888dc8de tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:24.178411 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5762e50b-1f75-48a4-93b1-e3f6888dc8de tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:24.312743 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-5762e50b-1f75-48a4-93b1-e3f6888dc8de tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f4e45a0882410088464b550a4b06c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc355242c9d490d91fbcbd7d08f8b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:45:24.320180 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-5762e50b-1f75-48a4-93b1-e3f6888dc8de tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177" status: 200 len: 1575 microversion: 2.1 time: 0.154324 Jun 30 18:45:24.320753 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 624/1256] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:45:24 2022] GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:45:24.851497 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-3ed34583-62c0-4760-8593-d63da4b094d6 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:45:24.852086 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-3ed34583-62c0-4760-8593-d63da4b094d6 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 0580042d-65ab-4b3f-9ab5-15464bb95ac1] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:24.858064 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3ed34583-62c0-4760-8593-d63da4b094d6 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:24.858500 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3ed34583-62c0-4760-8593-d63da4b094d6 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:24.859243 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3ed34583-62c0-4760-8593-d63da4b094d6 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:24.859664 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3ed34583-62c0-4760-8593-d63da4b094d6 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:25.068212 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-3ed34583-62c0-4760-8593-d63da4b094d6 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:45:25.076347 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-3ed34583-62c0-4760-8593-d63da4b094d6 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1" status: 200 len: 1367 microversion: 2.1 time: 0.228842 Jun 30 18:45:25.076946 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 633/1257] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:45:24 2022] GET /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1 => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:45:25.337180 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-1a4429f9-0277-4acc-8356-1e3a394bd157 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:45:25.337823 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-1a4429f9-0277-4acc-8356-1e3a394bd157 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:25.344227 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-1a4429f9-0277-4acc-8356-1e3a394bd157 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:25.344676 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-1a4429f9-0277-4acc-8356-1e3a394bd157 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:25.345431 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-1a4429f9-0277-4acc-8356-1e3a394bd157 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:25.345894 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-1a4429f9-0277-4acc-8356-1e3a394bd157 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:25.478960 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-1a4429f9-0277-4acc-8356-1e3a394bd157 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f4e45a0882410088464b550a4b06c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc355242c9d490d91fbcbd7d08f8b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:45:25.486272 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-1a4429f9-0277-4acc-8356-1e3a394bd157 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177" status: 200 len: 1575 microversion: 2.1 time: 0.153282 Jun 30 18:45:25.486825 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 625/1258] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:45:25 2022] GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:45:26.051544 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-c7491b83-7843-4eb9-b339-242b7a181639 req-8b1d7e81-1a32-4604-bb10-030afacb86e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0580042d-65ab-4b3f-9ab5-15464bb95ac1", "name": "network-vif-plugged", "status": "completed", "tag": "04598684-b276-472a-9961-96c41c95ca61"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:45:26.055584 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell0:SELECT=14 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:45:26.062231 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-c7491b83-7843-4eb9-b339-242b7a181639 req-8b1d7e81-1a32-4604-bb10-030afacb86e8 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:26.062665 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-c7491b83-7843-4eb9-b339-242b7a181639 req-8b1d7e81-1a32-4604-bb10-030afacb86e8 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:26.074374 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.compute.server_external_events [req-c7491b83-7843-4eb9-b339-242b7a181639 req-8b1d7e81-1a32-4604-bb10-030afacb86e8 service nova] Creating event network-vif-plugged:04598684-b276-472a-9961-96c41c95ca61 for instance 0580042d-65ab-4b3f-9ab5-15464bb95ac1 on hv-cinder-80378 Jun 30 18:45:26.079353 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-c7491b83-7843-4eb9-b339-242b7a181639 req-8b1d7e81-1a32-4604-bb10-030afacb86e8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031574 Jun 30 18:45:26.080013 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 634/1259] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:45:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:45:26.093606 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-5f24592e-ca87-4c00-bfb8-85875b952d46 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:45:26.094221 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-5f24592e-ca87-4c00-bfb8-85875b952d46 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 0580042d-65ab-4b3f-9ab5-15464bb95ac1] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:26.096071 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:45:26.101400 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5f24592e-ca87-4c00-bfb8-85875b952d46 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:26.101903 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5f24592e-ca87-4c00-bfb8-85875b952d46 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:26.102647 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5f24592e-ca87-4c00-bfb8-85875b952d46 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:26.103072 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-5f24592e-ca87-4c00-bfb8-85875b952d46 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:26.234688 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-5f24592e-ca87-4c00-bfb8-85875b952d46 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:45:26.243256 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-5f24592e-ca87-4c00-bfb8-85875b952d46 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1" status: 200 len: 1367 microversion: 2.1 time: 0.153368 Jun 30 18:45:26.243836 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 626/1260] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:45:26 2022] GET /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:45:26.503551 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-a15e2ae9-153a-4505-a288-6ab757c4ae98 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:45:26.504234 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-a15e2ae9-153a-4505-a288-6ab757c4ae98 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:26.510997 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a15e2ae9-153a-4505-a288-6ab757c4ae98 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:26.511434 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a15e2ae9-153a-4505-a288-6ab757c4ae98 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:26.512182 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a15e2ae9-153a-4505-a288-6ab757c4ae98 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:26.512611 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a15e2ae9-153a-4505-a288-6ab757c4ae98 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:26.645212 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-a15e2ae9-153a-4505-a288-6ab757c4ae98 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f4e45a0882410088464b550a4b06c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc355242c9d490d91fbcbd7d08f8b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:45:26.653624 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-a15e2ae9-153a-4505-a288-6ab757c4ae98 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177" status: 200 len: 1575 microversion: 2.1 time: 0.154244 Jun 30 18:45:26.654195 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 635/1261] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:45:26 2022] GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:45:27.260634 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-9ac786a5-20be-4f3f-be68-e7ae0c518959 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:45:27.261246 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-9ac786a5-20be-4f3f-be68-e7ae0c518959 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 0580042d-65ab-4b3f-9ab5-15464bb95ac1] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:27.267780 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9ac786a5-20be-4f3f-be68-e7ae0c518959 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:27.268226 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9ac786a5-20be-4f3f-be68-e7ae0c518959 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:27.268980 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9ac786a5-20be-4f3f-be68-e7ae0c518959 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:27.269431 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-9ac786a5-20be-4f3f-be68-e7ae0c518959 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:27.403871 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-9ac786a5-20be-4f3f-be68-e7ae0c518959 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:45:27.411183 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-9ac786a5-20be-4f3f-be68-e7ae0c518959 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1" status: 200 len: 1367 microversion: 2.1 time: 0.154959 Jun 30 18:45:27.411741 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 627/1262] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:45:27 2022] GET /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:45:27.671809 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-e918605d-e164-42c2-a0f4-a544a8b649da tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:45:27.672482 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-e918605d-e164-42c2-a0f4-a544a8b649da tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:27.676070 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:45:27.683117 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e918605d-e164-42c2-a0f4-a544a8b649da tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:27.684100 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e918605d-e164-42c2-a0f4-a544a8b649da tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:27.684829 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e918605d-e164-42c2-a0f4-a544a8b649da tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:27.685052 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-e918605d-e164-42c2-a0f4-a544a8b649da tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:27.824142 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-e918605d-e164-42c2-a0f4-a544a8b649da tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f4e45a0882410088464b550a4b06c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc355242c9d490d91fbcbd7d08f8b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:45:27.831659 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-e918605d-e164-42c2-a0f4-a544a8b649da tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177" status: 200 len: 1575 microversion: 2.1 time: 0.164322 Jun 30 18:45:27.832226 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 636/1263] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:45:27 2022] GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:45:28.428256 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-65df8167-df70-4aa3-976c-85a169f4fe6c tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:45:28.428809 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-65df8167-df70-4aa3-976c-85a169f4fe6c tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 0580042d-65ab-4b3f-9ab5-15464bb95ac1] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:28.435744 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-65df8167-df70-4aa3-976c-85a169f4fe6c tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:28.436193 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-65df8167-df70-4aa3-976c-85a169f4fe6c tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:28.436942 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-65df8167-df70-4aa3-976c-85a169f4fe6c tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:28.437377 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-65df8167-df70-4aa3-976c-85a169f4fe6c tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:28.564137 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-65df8167-df70-4aa3-976c-85a169f4fe6c tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:45:28.572267 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-65df8167-df70-4aa3-976c-85a169f4fe6c tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1" status: 200 len: 1557 microversion: 2.1 time: 0.147931 Jun 30 18:45:28.572828 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 628/1264] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:45:28 2022] GET /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1 => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:45:28.589145 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-15298ffb-3425-443f-a4d9-4e041de59f5f tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:45:28.589669 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-15298ffb-3425-443f-a4d9-4e041de59f5f tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 0580042d-65ab-4b3f-9ab5-15464bb95ac1] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:28.595769 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-15298ffb-3425-443f-a4d9-4e041de59f5f tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:28.596244 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-15298ffb-3425-443f-a4d9-4e041de59f5f tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:28.596994 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-15298ffb-3425-443f-a4d9-4e041de59f5f tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:28.597452 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-15298ffb-3425-443f-a4d9-4e041de59f5f tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:28.676041 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-15298ffb-3425-443f-a4d9-4e041de59f5f tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091490 Jun 30 18:45:28.676633 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 637/1265] 10.222.0.33 () {58 vars in 1274 bytes} [Thu Jun 30 18:45:28 2022] GET /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:45:28.848252 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-c1348df0-cc3d-44f2-9f61-59ed0ef6fb53 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:45:28.848861 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-c1348df0-cc3d-44f2-9f61-59ed0ef6fb53 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:28.854849 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c1348df0-cc3d-44f2-9f61-59ed0ef6fb53 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:28.855297 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c1348df0-cc3d-44f2-9f61-59ed0ef6fb53 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:28.856053 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c1348df0-cc3d-44f2-9f61-59ed0ef6fb53 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:28.856488 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c1348df0-cc3d-44f2-9f61-59ed0ef6fb53 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:29.115178 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-c1348df0-cc3d-44f2-9f61-59ed0ef6fb53 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f4e45a0882410088464b550a4b06c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc355242c9d490d91fbcbd7d08f8b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:45:29.123557 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-c1348df0-cc3d-44f2-9f61-59ed0ef6fb53 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177" status: 200 len: 1575 microversion: 2.1 time: 0.279165 Jun 30 18:45:29.124327 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 629/1266] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:45:28 2022] GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177 => generated 1575 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:45:29.652214 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-44b1ade0-0ccc-46e7-9ff7-02e02de4324d req-33e6bd48-cf7b-4e38-9696-768db727bf5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0580042d-65ab-4b3f-9ab5-15464bb95ac1", "tag": "04598684-b276-472a-9961-96c41c95ca61"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:45:29.660145 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-44b1ade0-0ccc-46e7-9ff7-02e02de4324d req-33e6bd48-cf7b-4e38-9696-768db727bf5e service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:29.660579 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-44b1ade0-0ccc-46e7-9ff7-02e02de4324d req-33e6bd48-cf7b-4e38-9696-768db727bf5e service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:29.671854 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.compute.server_external_events [req-44b1ade0-0ccc-46e7-9ff7-02e02de4324d req-33e6bd48-cf7b-4e38-9696-768db727bf5e service nova] Creating event network-changed:04598684-b276-472a-9961-96c41c95ca61 for instance 0580042d-65ab-4b3f-9ab5-15464bb95ac1 on hv-cinder-80378 Jun 30 18:45:29.676546 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-44b1ade0-0ccc-46e7-9ff7-02e02de4324d req-33e6bd48-cf7b-4e38-9696-768db727bf5e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028530 Jun 30 18:45:29.677352 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 638/1267] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:45:30.140450 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-0716757d-c74d-4ba3-8cb2-52a2a367d444 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:45:30.141059 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-0716757d-c74d-4ba3-8cb2-52a2a367d444 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:30.147941 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0716757d-c74d-4ba3-8cb2-52a2a367d444 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:30.148473 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0716757d-c74d-4ba3-8cb2-52a2a367d444 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:30.149277 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0716757d-c74d-4ba3-8cb2-52a2a367d444 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:30.149775 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0716757d-c74d-4ba3-8cb2-52a2a367d444 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:30.311352 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-0716757d-c74d-4ba3-8cb2-52a2a367d444 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f4e45a0882410088464b550a4b06c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc355242c9d490d91fbcbd7d08f8b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:45:30.319035 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-0716757d-c74d-4ba3-8cb2-52a2a367d444 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177" status: 200 len: 1575 microversion: 2.1 time: 0.182674 Jun 30 18:45:30.320148 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 630/1268] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:45:30 2022] GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177 => generated 1575 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:45:31.338400 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-c757228c-169b-4ce2-bd4a-68934e1f7588 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:45:31.339006 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-c757228c-169b-4ce2-bd4a-68934e1f7588 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:31.345144 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c757228c-169b-4ce2-bd4a-68934e1f7588 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:31.345604 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c757228c-169b-4ce2-bd4a-68934e1f7588 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:31.346376 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c757228c-169b-4ce2-bd4a-68934e1f7588 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:31.346825 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c757228c-169b-4ce2-bd4a-68934e1f7588 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:31.477956 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-c757228c-169b-4ce2-bd4a-68934e1f7588 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f4e45a0882410088464b550a4b06c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc355242c9d490d91fbcbd7d08f8b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:45:31.487077 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-c757228c-169b-4ce2-bd4a-68934e1f7588 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177" status: 200 len: 1575 microversion: 2.1 time: 0.154338 Jun 30 18:45:31.487645 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 639/1269] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:45:31 2022] GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:45:32.504366 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-32f86afb-9b8d-49f5-9912-aa23e1231767 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:45:32.504963 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-32f86afb-9b8d-49f5-9912-aa23e1231767 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:32.511438 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-32f86afb-9b8d-49f5-9912-aa23e1231767 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:32.511882 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-32f86afb-9b8d-49f5-9912-aa23e1231767 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:32.512629 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-32f86afb-9b8d-49f5-9912-aa23e1231767 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:32.513061 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-32f86afb-9b8d-49f5-9912-aa23e1231767 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:32.897183 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-32f86afb-9b8d-49f5-9912-aa23e1231767 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f4e45a0882410088464b550a4b06c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc355242c9d490d91fbcbd7d08f8b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:45:32.905408 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-32f86afb-9b8d-49f5-9912-aa23e1231767 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177" status: 200 len: 1575 microversion: 2.1 time: 0.404893 Jun 30 18:45:32.906008 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 631/1270] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:45:32 2022] GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177 => generated 1575 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:45:33.922637 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-0525f624-eb7a-47ae-8edd-fd9b193f61a5 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:45:33.923278 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-0525f624-eb7a-47ae-8edd-fd9b193f61a5 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:33.931043 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0525f624-eb7a-47ae-8edd-fd9b193f61a5 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:33.931660 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0525f624-eb7a-47ae-8edd-fd9b193f61a5 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:33.932892 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0525f624-eb7a-47ae-8edd-fd9b193f61a5 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:33.933334 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0525f624-eb7a-47ae-8edd-fd9b193f61a5 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:34.089749 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-0525f624-eb7a-47ae-8edd-fd9b193f61a5 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f4e45a0882410088464b550a4b06c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc355242c9d490d91fbcbd7d08f8b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:45:34.097180 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-0525f624-eb7a-47ae-8edd-fd9b193f61a5 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177" status: 200 len: 1575 microversion: 2.1 time: 0.178678 Jun 30 18:45:34.097777 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 640/1271] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:45:33 2022] GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177 => generated 1575 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:45:35.115261 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-a3b78296-47af-4d52-9ad8-f4ab08b7515f tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:45:35.115872 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-a3b78296-47af-4d52-9ad8-f4ab08b7515f tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:35.122542 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a3b78296-47af-4d52-9ad8-f4ab08b7515f tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:35.122984 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a3b78296-47af-4d52-9ad8-f4ab08b7515f tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:35.123733 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a3b78296-47af-4d52-9ad8-f4ab08b7515f tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:35.124164 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-a3b78296-47af-4d52-9ad8-f4ab08b7515f tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:35.253512 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-a3b78296-47af-4d52-9ad8-f4ab08b7515f tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f4e45a0882410088464b550a4b06c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc355242c9d490d91fbcbd7d08f8b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:45:35.262135 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-a3b78296-47af-4d52-9ad8-f4ab08b7515f tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177" status: 200 len: 1575 microversion: 2.1 time: 0.150769 Jun 30 18:45:35.262702 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 632/1272] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:45:35 2022] GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:45:35.744702 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [req-a0b27005-7dd6-45ed-b271-bac985c9dbab req-9584feb2-f9cb-4310-af31-ab851761919e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e521acf7-4c22-4f2f-9014-0fe2b98e5177", "name": "network-vif-plugged", "status": "completed", "tag": "2f35c8e5-f600-4e52-a4cb-3e624aeebaff"}]} {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:45:35.754984 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-a0b27005-7dd6-45ed-b271-bac985c9dbab req-9584feb2-f9cb-4310-af31-ab851761919e service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:35.755423 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [req-a0b27005-7dd6-45ed-b271-bac985c9dbab req-9584feb2-f9cb-4310-af31-ab851761919e service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:35.767445 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.compute.server_external_events [req-a0b27005-7dd6-45ed-b271-bac985c9dbab req-9584feb2-f9cb-4310-af31-ab851761919e service nova] Creating event network-vif-plugged:2f35c8e5-f600-4e52-a4cb-3e624aeebaff for instance e521acf7-4c22-4f2f-9014-0fe2b98e5177 on hv-cinder-80378 Jun 30 18:45:35.771998 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [req-a0b27005-7dd6-45ed-b271-bac985c9dbab req-9584feb2-f9cb-4310-af31-ab851761919e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032844 Jun 30 18:45:35.773381 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 641/1273] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:45:36.279644 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-7c992f93-95b5-4ee3-8db8-322150024efc tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:45:36.280205 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-7c992f93-95b5-4ee3-8db8-322150024efc tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:36.286695 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7c992f93-95b5-4ee3-8db8-322150024efc tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:36.287127 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7c992f93-95b5-4ee3-8db8-322150024efc tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:36.287882 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7c992f93-95b5-4ee3-8db8-322150024efc tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:36.288971 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-7c992f93-95b5-4ee3-8db8-322150024efc tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:36.415996 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-7c992f93-95b5-4ee3-8db8-322150024efc tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f4e45a0882410088464b550a4b06c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc355242c9d490d91fbcbd7d08f8b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:45:36.423641 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-7c992f93-95b5-4ee3-8db8-322150024efc tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177" status: 200 len: 1575 microversion: 2.1 time: 0.147943 Jun 30 18:45:36.424212 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 633/1274] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:45:36 2022] GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177 => generated 1575 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:45:37.441663 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-904b60ed-220e-49ac-84ec-24bb9306505f tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:45:37.442275 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-904b60ed-220e-49ac-84ec-24bb9306505f tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:37.450108 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-904b60ed-220e-49ac-84ec-24bb9306505f tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:37.450543 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-904b60ed-220e-49ac-84ec-24bb9306505f tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:37.451304 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-904b60ed-220e-49ac-84ec-24bb9306505f tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:37.451732 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-904b60ed-220e-49ac-84ec-24bb9306505f tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:37.590461 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-904b60ed-220e-49ac-84ec-24bb9306505f tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f4e45a0882410088464b550a4b06c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc355242c9d490d91fbcbd7d08f8b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:45:37.597862 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-904b60ed-220e-49ac-84ec-24bb9306505f tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177" status: 200 len: 1575 microversion: 2.1 time: 0.160976 Jun 30 18:45:37.598421 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 642/1275] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:45:37 2022] GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:45:38.615362 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-c33d5ec6-438f-404f-9daf-ae591b9d2124 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:45:38.615966 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-c33d5ec6-438f-404f-9daf-ae591b9d2124 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:45:38.623346 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c33d5ec6-438f-404f-9daf-ae591b9d2124 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:38.623792 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c33d5ec6-438f-404f-9daf-ae591b9d2124 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:38.624555 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c33d5ec6-438f-404f-9daf-ae591b9d2124 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:45:38.624992 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-c33d5ec6-438f-404f-9daf-ae591b9d2124 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:45:38.643644 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:45:38.756256 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-c33d5ec6-438f-404f-9daf-ae591b9d2124 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f4e45a0882410088464b550a4b06c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc355242c9d490d91fbcbd7d08f8b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:45:38.763815 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-c33d5ec6-438f-404f-9daf-ae591b9d2124 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177" status: 200 len: 1562 microversion: 2.1 time: 0.152362 Jun 30 18:45:38.764378 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 634/1276] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:45:38 2022] GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177 => generated 1562 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:46:44.640216 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_api:SELECT=13 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:46:44.641079 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG dbcounter [-] [117941] Writing DB stats nova_cell1:SELECT=56 {{(pid=117941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:46:44.645426 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-ddf5e488-a190-4195-a22d-a203c0a167f7 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:46:44.645968 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-ddf5e488-a190-4195-a22d-a203c0a167f7 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 0580042d-65ab-4b3f-9ab5-15464bb95ac1] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:46:44.652808 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ddf5e488-a190-4195-a22d-a203c0a167f7 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:46:44.653251 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ddf5e488-a190-4195-a22d-a203c0a167f7 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:46:44.654026 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ddf5e488-a190-4195-a22d-a203c0a167f7 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:46:44.654658 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ddf5e488-a190-4195-a22d-a203c0a167f7 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:46:44.680422 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-ddf5e488-a190-4195-a22d-a203c0a167f7 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1/ips" status: 200 len: 149 microversion: 2.1 time: 0.042083 Jun 30 18:46:44.680984 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 643/1277] 10.222.0.33 () {58 vars in 1247 bytes} [Thu Jun 30 18:46:44 2022] GET /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:46:45.992442 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_api:SELECT=17 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:46:45.993189 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG dbcounter [-] [117940] Writing DB stats nova_cell1:SELECT=2 {{(pid=117940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:46:45.997923 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-3601068e-e465-4099-8e6d-b3ad122c11f3 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b096aa6a-5481-45c7-8e4e-282ce9ebd25c"}} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:46:45.999037 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-3601068e-e465-4099-8e6d-b3ad122c11f3 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 0580042d-65ab-4b3f-9ab5-15464bb95ac1] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:46:46.005602 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3601068e-e465-4099-8e6d-b3ad122c11f3 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:46:46.006055 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3601068e-e465-4099-8e6d-b3ad122c11f3 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:46:46.007378 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3601068e-e465-4099-8e6d-b3ad122c11f3 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:46:46.007839 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-3601068e-e465-4099-8e6d-b3ad122c11f3 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:46:46.253908 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-3601068e-e465-4099-8e6d-b3ad122c11f3 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "POST /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263150 Jun 30 18:46:46.254512 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 635/1278] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 30 18:46:45 2022] POST /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:46:47.025236 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:46:47.025934 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Thu Jun 30 18:46:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:46:53.836506 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-a6ca6622-4c43-4469-84d3-0f5846d68898 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:46:53.837143 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-a6ca6622-4c43-4469-84d3-0f5846d68898 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 0580042d-65ab-4b3f-9ab5-15464bb95ac1] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:46:53.843567 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a6ca6622-4c43-4469-84d3-0f5846d68898 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:46:53.844014 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a6ca6622-4c43-4469-84d3-0f5846d68898 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:46:53.844771 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a6ca6622-4c43-4469-84d3-0f5846d68898 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:46:53.845202 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a6ca6622-4c43-4469-84d3-0f5846d68898 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:46:53.925424 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.objects.instance [None req-a6ca6622-4c43-4469-84d3-0f5846d68898 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lazy-loading 'services' on Instance uuid 0580042d-65ab-4b3f-9ab5-15464bb95ac1 {{(pid=117941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 18:46:53.997325 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-a6ca6622-4c43-4469-84d3-0f5846d68898 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1/os-volume_attachments/b096aa6a-5481-45c7-8e4e-282ce9ebd25c" status: 202 len: 0 microversion: 2.1 time: 0.165085 Jun 30 18:46:53.997975 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 644/1279] 10.222.0.33 () {58 vars in 1415 bytes} [Thu Jun 30 18:46:53 2022] DELETE /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1/os-volume_attachments/b096aa6a-5481-45c7-8e4e-282ce9ebd25c => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 18:46:54.007430 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-e7e38cf4-159a-4f7f-98cb-3f0bde1cbf2a tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:46:54.008670 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-e7e38cf4-159a-4f7f-98cb-3f0bde1cbf2a tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 0580042d-65ab-4b3f-9ab5-15464bb95ac1] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:46:54.015719 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e7e38cf4-159a-4f7f-98cb-3f0bde1cbf2a tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:46:54.016347 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e7e38cf4-159a-4f7f-98cb-3f0bde1cbf2a tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:46:54.017122 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e7e38cf4-159a-4f7f-98cb-3f0bde1cbf2a tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:46:54.017547 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-e7e38cf4-159a-4f7f-98cb-3f0bde1cbf2a tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:46:54.049257 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-e7e38cf4-159a-4f7f-98cb-3f0bde1cbf2a tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046642 Jun 30 18:46:54.050009 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 636/1280] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 30 18:46:54 2022] GET /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:46:55.061393 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-3690450a-afa2-4f60-847b-3380379b1068 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:46:55.062570 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-3690450a-afa2-4f60-847b-3380379b1068 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 0580042d-65ab-4b3f-9ab5-15464bb95ac1] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:46:55.069331 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3690450a-afa2-4f60-847b-3380379b1068 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:46:55.069936 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3690450a-afa2-4f60-847b-3380379b1068 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:46:55.079228 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3690450a-afa2-4f60-847b-3380379b1068 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:46:55.079904 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3690450a-afa2-4f60-847b-3380379b1068 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:46:55.116241 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-3690450a-afa2-4f60-847b-3380379b1068 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059124 Jun 30 18:46:55.117867 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 645/1281] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 30 18:46:55 2022] GET /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 18:46:55.172926 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-cbefdbd8-81de-4d75-aa73-22a7c282a0ba tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:46:55.173434 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-cbefdbd8-81de-4d75-aa73-22a7c282a0ba tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 0580042d-65ab-4b3f-9ab5-15464bb95ac1] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:46:55.180299 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cbefdbd8-81de-4d75-aa73-22a7c282a0ba tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:46:55.180741 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cbefdbd8-81de-4d75-aa73-22a7c282a0ba tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:46:55.181487 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cbefdbd8-81de-4d75-aa73-22a7c282a0ba tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:46:55.181964 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cbefdbd8-81de-4d75-aa73-22a7c282a0ba tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:46:55.207165 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-cbefdbd8-81de-4d75-aa73-22a7c282a0ba tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 0580042d-65ab-4b3f-9ab5-15464bb95ac1] Going to try to terminate instance {{(pid=117940) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 18:46:55.283785 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-cbefdbd8-81de-4d75-aa73-22a7c282a0ba tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1" status: 204 len: 0 microversion: 2.1 time: 0.114315 Jun 30 18:46:55.284643 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 637/1282] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 30 18:46:55 2022] DELETE /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 18:46:55.294044 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-a3db9c37-28b5-4fae-a8f9-c2c75a3395b4 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:46:55.294653 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-a3db9c37-28b5-4fae-a8f9-c2c75a3395b4 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 0580042d-65ab-4b3f-9ab5-15464bb95ac1] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:46:55.300580 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a3db9c37-28b5-4fae-a8f9-c2c75a3395b4 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:46:55.301019 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a3db9c37-28b5-4fae-a8f9-c2c75a3395b4 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:46:55.301797 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a3db9c37-28b5-4fae-a8f9-c2c75a3395b4 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:46:55.302228 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a3db9c37-28b5-4fae-a8f9-c2c75a3395b4 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:46:55.436001 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-a3db9c37-28b5-4fae-a8f9-c2c75a3395b4 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:46:55.443364 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-a3db9c37-28b5-4fae-a8f9-c2c75a3395b4 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1" status: 200 len: 1681 microversion: 2.1 time: 0.153671 Jun 30 18:46:55.443961 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 646/1283] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:46:55 2022] GET /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:46:56.461641 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-be43a3cd-c884-4cb3-bba4-40dfed9297f5 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:46:56.462337 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-be43a3cd-c884-4cb3-bba4-40dfed9297f5 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 0580042d-65ab-4b3f-9ab5-15464bb95ac1] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:46:56.468750 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-be43a3cd-c884-4cb3-bba4-40dfed9297f5 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:46:56.469188 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-be43a3cd-c884-4cb3-bba4-40dfed9297f5 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:46:56.469951 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-be43a3cd-c884-4cb3-bba4-40dfed9297f5 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:46:56.470375 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-be43a3cd-c884-4cb3-bba4-40dfed9297f5 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:46:56.600012 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-be43a3cd-c884-4cb3-bba4-40dfed9297f5 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:46:56.608390 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-be43a3cd-c884-4cb3-bba4-40dfed9297f5 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1" status: 200 len: 1681 microversion: 2.1 time: 0.151010 Jun 30 18:46:56.608956 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 638/1284] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:46:56 2022] GET /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:46:57.626964 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-c76bf48d-04f7-4184-a8f7-3630023dcff2 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:46:57.627572 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-c76bf48d-04f7-4184-a8f7-3630023dcff2 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 0580042d-65ab-4b3f-9ab5-15464bb95ac1] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:46:57.635338 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c76bf48d-04f7-4184-a8f7-3630023dcff2 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:46:57.635914 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c76bf48d-04f7-4184-a8f7-3630023dcff2 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:46:57.636690 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c76bf48d-04f7-4184-a8f7-3630023dcff2 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:46:57.637124 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-c76bf48d-04f7-4184-a8f7-3630023dcff2 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:46:57.753870 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-c76bf48d-04f7-4184-a8f7-3630023dcff2 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9531d18446eb4488bbd1511cb3412925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8227be3d9a044ed888b2f54abd9463d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:46:57.763278 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-c76bf48d-04f7-4184-a8f7-3630023dcff2 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1" status: 200 len: 1614 microversion: 2.1 time: 0.140132 Jun 30 18:46:57.763864 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 647/1285] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:46:57 2022] GET /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1 => generated 1614 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:46:57.952228 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [req-678d1430-3047-4b6f-85bb-4d694d67f816 req-f695243f-945c-4ad1-8cfd-ab66c57d6360 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0580042d-65ab-4b3f-9ab5-15464bb95ac1", "name": "network-vif-deleted", "tag": "04598684-b276-472a-9961-96c41c95ca61"}]} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:46:57.960388 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-678d1430-3047-4b6f-85bb-4d694d67f816 req-f695243f-945c-4ad1-8cfd-ab66c57d6360 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:46:57.960937 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-678d1430-3047-4b6f-85bb-4d694d67f816 req-f695243f-945c-4ad1-8cfd-ab66c57d6360 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:46:57.976713 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.compute.server_external_events [req-678d1430-3047-4b6f-85bb-4d694d67f816 req-f695243f-945c-4ad1-8cfd-ab66c57d6360 service nova] Creating event network-vif-deleted:04598684-b276-472a-9961-96c41c95ca61 for instance 0580042d-65ab-4b3f-9ab5-15464bb95ac1 on hv-cinder-80378 Jun 30 18:46:57.982072 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [req-678d1430-3047-4b6f-85bb-4d694d67f816 req-f695243f-945c-4ad1-8cfd-ab66c57d6360 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035861 Jun 30 18:46:57.983262 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 639/1286] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:46:58.780452 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-826a066f-54f7-49b6-8e86-a4061824a465 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:46:58.781068 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-826a066f-54f7-49b6-8e86-a4061824a465 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 0580042d-65ab-4b3f-9ab5-15464bb95ac1] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:46:58.787908 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-826a066f-54f7-49b6-8e86-a4061824a465 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:46:58.788356 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-826a066f-54f7-49b6-8e86-a4061824a465 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:46:58.789334 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-826a066f-54f7-49b6-8e86-a4061824a465 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:46:58.789871 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-826a066f-54f7-49b6-8e86-a4061824a465 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:46:58.803655 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.wsgi [None req-826a066f-54f7-49b6-8e86-a4061824a465 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] HTTP exception thrown: Instance 0580042d-65ab-4b3f-9ab5-15464bb95ac1 could not be found. Jun 30 18:46:58.805309 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-826a066f-54f7-49b6-8e86-a4061824a465 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Request method failure captured: Jun 30 18:46:58.805309 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: request: GET /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1 HTTP/1.1 Jun 30 18:46:58.805309 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept: application/json Jun 30 18:46:58.805309 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept-Encoding: identity Jun 30 18:46:58.805309 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Connection: close Jun 30 18:46:58.805309 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Length: 0 Jun 30 18:46:58.805309 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Type: application/json Jun 30 18:46:58.805309 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Host: 10.222.0.33 Jun 30 18:46:58.805309 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Openstack-System-Scope: None Jun 30 18:46:58.805309 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: User-Agent: python-urllib3/1.26.9 Jun 30 18:46:58.805309 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Auth-Token: gAAAAABive3_mQ4kZ2JNveNggCM2j6Qam1PzZzze4niNBx_ABO6k3xVntyI41bCtbU1dqHi3AaxJKokcovO0E907Am7gbM4_Spd2N8jkkVzqboNWXgAyxs4i5CVIc1cpe4RDkM3IBciZBWXtbJ1cU6IuTIKWreKtjsnNHJNRFm0dFUHScNhmgkQ Jun 30 18:46:58.805309 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Id: None Jun 30 18:46:58.805309 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Name: None Jun 30 18:46:58.805309 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Identity-Status: Confirmed Jun 30 18:46:58.805309 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Is-Admin-Project: True Jun 30 18:46:58.805309 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Id: default Jun 30 18:46:58.805309 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Name: Default Jun 30 18:46:58.805309 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Id: b8227be3d9a044ed888b2f54abd9463d Jun 30 18:46:58.805309 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Name: tempest-AttachVolumeNegativeTest-1944998081 Jun 30 18:46:58.805309 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Role: reader,member Jun 30 18:46:58.805309 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Roles: reader,member Jun 30 18:46:58.807232 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b8227be3d9a044ed888b2f54abd9463d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b8227be3d9a044ed888b2f54abd9463d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b8227be3d9a044ed888b2f54abd9463d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b8227be3d9a044ed888b2f54abd9463d"}]}] Jun 30 18:46:58.807232 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant: tempest-AttachVolumeNegativeTest-1944998081 Jun 30 18:46:58.807232 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Id: b8227be3d9a044ed888b2f54abd9463d Jun 30 18:46:58.807232 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1944998081 Jun 30 18:46:58.807232 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User: tempest-AttachVolumeNegativeTest-1944998081-project Jun 30 18:46:58.807232 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Id: default Jun 30 18:46:58.807232 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Name: Default Jun 30 18:46:58.807232 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Id: 9531d18446eb4488bbd1511cb3412925 Jun 30 18:46:58.807232 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Name: tempest-AttachVolumeNegativeTest-1944998081-project Jun 30 18:46:58.807232 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: method: > Jun 30 18:46:58.807232 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: exception: Instance 0580042d-65ab-4b3f-9ab5-15464bb95ac1 could not be found. Jun 30 18:46:58.807232 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: action_args: {'id': '0580042d-65ab-4b3f-9ab5-15464bb95ac1'} Jun 30 18:46:58.808167 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:46:58.808167 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:46:58.808167 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:46:58.808167 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:46:58.808167 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:46:58.808167 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:46:58.808167 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:46:58.808167 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:46:58.808167 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:46:58.808167 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:46:58.808167 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0580042d-65ab-4b3f-9ab5-15464bb95ac1 could not be found. Jun 30 18:46:58.808167 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:46:58.808167 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:46:58.808167 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:46:58.808167 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:46:58.808167 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:46:58.808167 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:46:58.808167 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:46:58.808167 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:46:58.808167 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:46:58.809704 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:46:58.809704 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:46:58.809704 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:46:58.809704 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:46:58.809704 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:46:58.809704 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:46:58.809704 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:46:58.809704 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0580042d-65ab-4b3f-9ab5-15464bb95ac1 could not be found. Jun 30 18:46:58.809704 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:46:58.809704 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:46:58.809704 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:46:58.809704 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:46:58.809704 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:46:58.809704 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:46:58.809704 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:46:58.809704 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:46:58.809704 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0580042d-65ab-4b3f-9ab5-15464bb95ac1 could not be found. Jun 30 18:46:58.809704 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:46:58.811061 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-826a066f-54f7-49b6-8e86-a4061824a465 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Returning 404 to user: Instance 0580042d-65ab-4b3f-9ab5-15464bb95ac1 could not be found. {{(pid=117941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:46:58.811061 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-826a066f-54f7-49b6-8e86-a4061824a465 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1" status: 404 len: 111 microversion: 2.1 time: 0.030389 Jun 30 18:46:58.811061 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 648/1287] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:46:58 2022] GET /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 30 18:46:58.816856 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-1a21d848-afad-46ce-ae3f-87ccc3a3b376 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '.version_select at 0x7f18055f23a0>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:46:58.838338 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-1a21d848-afad-46ce-ae3f-87ccc3a3b376 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1413659994" status: 202 len: 0 microversion: 2.1 time: 0.025503 Jun 30 18:46:58.838914 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 640/1288] 10.222.0.33 () {58 vars in 1220 bytes} [Thu Jun 30 18:46:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1413659994 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 18:47:00.578183 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-0d6f3b46-0f58-41ea-9994-af1e0cf9f40d tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:47:00.578667 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-0d6f3b46-0f58-41ea-9994-af1e0cf9f40d tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 0580042d-65ab-4b3f-9ab5-15464bb95ac1] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:47:00.587171 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0d6f3b46-0f58-41ea-9994-af1e0cf9f40d tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:47:00.587623 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0d6f3b46-0f58-41ea-9994-af1e0cf9f40d tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:47:00.588382 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0d6f3b46-0f58-41ea-9994-af1e0cf9f40d tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:47:00.588814 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-0d6f3b46-0f58-41ea-9994-af1e0cf9f40d tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:47:00.602893 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.wsgi [None req-0d6f3b46-0f58-41ea-9994-af1e0cf9f40d tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] HTTP exception thrown: Instance 0580042d-65ab-4b3f-9ab5-15464bb95ac1 could not be found. Jun 30 18:47:00.604426 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-0d6f3b46-0f58-41ea-9994-af1e0cf9f40d tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Request method failure captured: Jun 30 18:47:00.604426 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: request: DELETE /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1 HTTP/1.1 Jun 30 18:47:00.604426 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept: application/json Jun 30 18:47:00.604426 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept-Encoding: identity Jun 30 18:47:00.604426 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Connection: close Jun 30 18:47:00.604426 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Length: 0 Jun 30 18:47:00.604426 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Type: application/json Jun 30 18:47:00.604426 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Host: 10.222.0.33 Jun 30 18:47:00.604426 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Openstack-System-Scope: None Jun 30 18:47:00.604426 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: User-Agent: python-urllib3/1.26.9 Jun 30 18:47:00.604426 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Auth-Token: gAAAAABive3_mQ4kZ2JNveNggCM2j6Qam1PzZzze4niNBx_ABO6k3xVntyI41bCtbU1dqHi3AaxJKokcovO0E907Am7gbM4_Spd2N8jkkVzqboNWXgAyxs4i5CVIc1cpe4RDkM3IBciZBWXtbJ1cU6IuTIKWreKtjsnNHJNRFm0dFUHScNhmgkQ Jun 30 18:47:00.604426 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Id: None Jun 30 18:47:00.604426 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Name: None Jun 30 18:47:00.604426 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Identity-Status: Confirmed Jun 30 18:47:00.604426 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Is-Admin-Project: True Jun 30 18:47:00.604426 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Id: default Jun 30 18:47:00.604426 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Name: Default Jun 30 18:47:00.604426 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Id: b8227be3d9a044ed888b2f54abd9463d Jun 30 18:47:00.604426 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Name: tempest-AttachVolumeNegativeTest-1944998081 Jun 30 18:47:00.604426 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Role: reader,member Jun 30 18:47:00.604426 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Roles: reader,member Jun 30 18:47:00.606213 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b8227be3d9a044ed888b2f54abd9463d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b8227be3d9a044ed888b2f54abd9463d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b8227be3d9a044ed888b2f54abd9463d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b8227be3d9a044ed888b2f54abd9463d"}]}] Jun 30 18:47:00.606213 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant: tempest-AttachVolumeNegativeTest-1944998081 Jun 30 18:47:00.606213 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Id: b8227be3d9a044ed888b2f54abd9463d Jun 30 18:47:00.606213 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1944998081 Jun 30 18:47:00.606213 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User: tempest-AttachVolumeNegativeTest-1944998081-project Jun 30 18:47:00.606213 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Id: default Jun 30 18:47:00.606213 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Name: Default Jun 30 18:47:00.606213 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Id: 9531d18446eb4488bbd1511cb3412925 Jun 30 18:47:00.606213 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Name: tempest-AttachVolumeNegativeTest-1944998081-project Jun 30 18:47:00.606213 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: method: > Jun 30 18:47:00.606213 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: exception: Instance 0580042d-65ab-4b3f-9ab5-15464bb95ac1 could not be found. Jun 30 18:47:00.606213 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: action_args: {'id': '0580042d-65ab-4b3f-9ab5-15464bb95ac1'} Jun 30 18:47:00.607276 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:47:00.607276 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:47:00.607276 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:47:00.607276 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:47:00.607276 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:47:00.607276 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:47:00.607276 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:47:00.607276 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:47:00.607276 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:47:00.607276 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:47:00.607276 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0580042d-65ab-4b3f-9ab5-15464bb95ac1 could not be found. Jun 30 18:47:00.607276 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:47:00.607276 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:47:00.607276 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:47:00.607276 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:47:00.607276 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:47:00.607276 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:47:00.607276 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:47:00.607276 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:47:00.607276 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:47:00.608961 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:47:00.608961 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 18:47:00.608961 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 18:47:00.608961 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 18:47:00.608961 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 18:47:00.608961 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:47:00.608961 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:47:00.608961 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:47:00.608961 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:47:00.608961 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0580042d-65ab-4b3f-9ab5-15464bb95ac1 could not be found. Jun 30 18:47:00.608961 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:47:00.608961 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:47:00.608961 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:47:00.608961 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:47:00.608961 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:47:00.608961 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:47:00.608961 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:47:00.608961 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:47:00.608961 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0580042d-65ab-4b3f-9ab5-15464bb95ac1 could not be found. Jun 30 18:47:00.608961 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:47:00.610671 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-0d6f3b46-0f58-41ea-9994-af1e0cf9f40d tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Returning 404 to user: Instance 0580042d-65ab-4b3f-9ab5-15464bb95ac1 could not be found. {{(pid=117941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:47:00.610671 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-0d6f3b46-0f58-41ea-9994-af1e0cf9f40d tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1" status: 404 len: 111 microversion: 2.1 time: 0.031460 Jun 30 18:47:00.610671 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 649/1289] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 30 18:47:00 2022] DELETE /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:47:00.614510 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-4bb2fe53-abaf-48aa-8f13-8e07d736ada1 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:47:00.615237 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-4bb2fe53-abaf-48aa-8f13-8e07d736ada1 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 0580042d-65ab-4b3f-9ab5-15464bb95ac1] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:47:00.622032 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-4bb2fe53-abaf-48aa-8f13-8e07d736ada1 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:47:00.622471 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-4bb2fe53-abaf-48aa-8f13-8e07d736ada1 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:47:00.623219 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-4bb2fe53-abaf-48aa-8f13-8e07d736ada1 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:47:00.623646 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-4bb2fe53-abaf-48aa-8f13-8e07d736ada1 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:47:00.636350 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.wsgi [None req-4bb2fe53-abaf-48aa-8f13-8e07d736ada1 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] HTTP exception thrown: Instance 0580042d-65ab-4b3f-9ab5-15464bb95ac1 could not be found. Jun 30 18:47:00.637957 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-4bb2fe53-abaf-48aa-8f13-8e07d736ada1 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Request method failure captured: Jun 30 18:47:00.637957 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: request: GET /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1 HTTP/1.1 Jun 30 18:47:00.637957 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept: application/json Jun 30 18:47:00.637957 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept-Encoding: identity Jun 30 18:47:00.637957 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Connection: close Jun 30 18:47:00.637957 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Length: 0 Jun 30 18:47:00.637957 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Type: application/json Jun 30 18:47:00.637957 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Host: 10.222.0.33 Jun 30 18:47:00.637957 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Openstack-System-Scope: None Jun 30 18:47:00.637957 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: User-Agent: python-urllib3/1.26.9 Jun 30 18:47:00.637957 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Auth-Token: gAAAAABive3_mQ4kZ2JNveNggCM2j6Qam1PzZzze4niNBx_ABO6k3xVntyI41bCtbU1dqHi3AaxJKokcovO0E907Am7gbM4_Spd2N8jkkVzqboNWXgAyxs4i5CVIc1cpe4RDkM3IBciZBWXtbJ1cU6IuTIKWreKtjsnNHJNRFm0dFUHScNhmgkQ Jun 30 18:47:00.637957 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Id: None Jun 30 18:47:00.637957 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Name: None Jun 30 18:47:00.637957 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Identity-Status: Confirmed Jun 30 18:47:00.637957 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Is-Admin-Project: True Jun 30 18:47:00.637957 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Id: default Jun 30 18:47:00.637957 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Name: Default Jun 30 18:47:00.637957 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Id: b8227be3d9a044ed888b2f54abd9463d Jun 30 18:47:00.637957 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Name: tempest-AttachVolumeNegativeTest-1944998081 Jun 30 18:47:00.637957 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Role: reader,member Jun 30 18:47:00.637957 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Roles: reader,member Jun 30 18:47:00.639723 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b8227be3d9a044ed888b2f54abd9463d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b8227be3d9a044ed888b2f54abd9463d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b8227be3d9a044ed888b2f54abd9463d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b8227be3d9a044ed888b2f54abd9463d"}]}] Jun 30 18:47:00.639723 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant: tempest-AttachVolumeNegativeTest-1944998081 Jun 30 18:47:00.639723 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Id: b8227be3d9a044ed888b2f54abd9463d Jun 30 18:47:00.639723 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1944998081 Jun 30 18:47:00.639723 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User: tempest-AttachVolumeNegativeTest-1944998081-project Jun 30 18:47:00.639723 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Id: default Jun 30 18:47:00.639723 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Name: Default Jun 30 18:47:00.639723 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Id: 9531d18446eb4488bbd1511cb3412925 Jun 30 18:47:00.639723 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Name: tempest-AttachVolumeNegativeTest-1944998081-project Jun 30 18:47:00.639723 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: method: > Jun 30 18:47:00.639723 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: exception: Instance 0580042d-65ab-4b3f-9ab5-15464bb95ac1 could not be found. Jun 30 18:47:00.639723 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: action_args: {'id': '0580042d-65ab-4b3f-9ab5-15464bb95ac1'} Jun 30 18:47:00.640787 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:47:00.640787 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:47:00.640787 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:47:00.640787 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:47:00.640787 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:47:00.640787 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:47:00.640787 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:47:00.640787 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:47:00.640787 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:47:00.640787 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:47:00.640787 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0580042d-65ab-4b3f-9ab5-15464bb95ac1 could not be found. Jun 30 18:47:00.640787 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:47:00.640787 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:47:00.640787 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:47:00.640787 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:47:00.640787 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:47:00.640787 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:47:00.640787 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:47:00.640787 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:47:00.640787 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:47:00.642660 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:47:00.642660 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:47:00.642660 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:47:00.642660 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:47:00.642660 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:47:00.642660 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:47:00.642660 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:47:00.642660 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0580042d-65ab-4b3f-9ab5-15464bb95ac1 could not be found. Jun 30 18:47:00.642660 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:47:00.642660 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:47:00.642660 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:47:00.642660 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:47:00.642660 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:47:00.642660 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:47:00.642660 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:47:00.642660 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:47:00.642660 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0580042d-65ab-4b3f-9ab5-15464bb95ac1 could not be found. Jun 30 18:47:00.642660 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:47:00.644199 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-4bb2fe53-abaf-48aa-8f13-8e07d736ada1 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Returning 404 to user: Instance 0580042d-65ab-4b3f-9ab5-15464bb95ac1 could not be found. {{(pid=117940) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:47:00.644199 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-4bb2fe53-abaf-48aa-8f13-8e07d736ada1 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1" status: 404 len: 111 microversion: 2.1 time: 0.029060 Jun 30 18:47:00.644199 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 641/1290] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:47:00 2022] GET /compute/v2.1/servers/0580042d-65ab-4b3f-9ab5-15464bb95ac1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:47:01.772613 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-21f9a583-381e-417b-a123-ee974cd3df85 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:47:01.773120 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-21f9a583-381e-417b-a123-ee974cd3df85 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: ee34e802-b1fb-4445-a92f-8860154b9e2d] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:47:01.780178 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-21f9a583-381e-417b-a123-ee974cd3df85 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:47:01.780615 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-21f9a583-381e-417b-a123-ee974cd3df85 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:47:01.781354 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-21f9a583-381e-417b-a123-ee974cd3df85 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:47:01.781872 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-21f9a583-381e-417b-a123-ee974cd3df85 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:47:01.797427 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.wsgi [None req-21f9a583-381e-417b-a123-ee974cd3df85 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] HTTP exception thrown: Instance ee34e802-b1fb-4445-a92f-8860154b9e2d could not be found. Jun 30 18:47:01.798962 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-21f9a583-381e-417b-a123-ee974cd3df85 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Request method failure captured: Jun 30 18:47:01.798962 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: request: DELETE /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d HTTP/1.1 Jun 30 18:47:01.798962 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept: application/json Jun 30 18:47:01.798962 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept-Encoding: identity Jun 30 18:47:01.798962 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Connection: close Jun 30 18:47:01.798962 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Length: 0 Jun 30 18:47:01.798962 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Type: application/json Jun 30 18:47:01.798962 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Host: 10.222.0.33 Jun 30 18:47:01.798962 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Openstack-System-Scope: None Jun 30 18:47:01.798962 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: User-Agent: python-urllib3/1.26.9 Jun 30 18:47:01.798962 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Auth-Token: gAAAAABive3_mQ4kZ2JNveNggCM2j6Qam1PzZzze4niNBx_ABO6k3xVntyI41bCtbU1dqHi3AaxJKokcovO0E907Am7gbM4_Spd2N8jkkVzqboNWXgAyxs4i5CVIc1cpe4RDkM3IBciZBWXtbJ1cU6IuTIKWreKtjsnNHJNRFm0dFUHScNhmgkQ Jun 30 18:47:01.798962 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Id: None Jun 30 18:47:01.798962 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Name: None Jun 30 18:47:01.798962 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Identity-Status: Confirmed Jun 30 18:47:01.798962 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Is-Admin-Project: True Jun 30 18:47:01.798962 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Id: default Jun 30 18:47:01.798962 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Name: Default Jun 30 18:47:01.798962 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Id: b8227be3d9a044ed888b2f54abd9463d Jun 30 18:47:01.798962 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Name: tempest-AttachVolumeNegativeTest-1944998081 Jun 30 18:47:01.798962 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Role: reader,member Jun 30 18:47:01.798962 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Roles: reader,member Jun 30 18:47:01.800727 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b8227be3d9a044ed888b2f54abd9463d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b8227be3d9a044ed888b2f54abd9463d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b8227be3d9a044ed888b2f54abd9463d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b8227be3d9a044ed888b2f54abd9463d"}]}] Jun 30 18:47:01.800727 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant: tempest-AttachVolumeNegativeTest-1944998081 Jun 30 18:47:01.800727 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Id: b8227be3d9a044ed888b2f54abd9463d Jun 30 18:47:01.800727 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1944998081 Jun 30 18:47:01.800727 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User: tempest-AttachVolumeNegativeTest-1944998081-project Jun 30 18:47:01.800727 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Id: default Jun 30 18:47:01.800727 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Name: Default Jun 30 18:47:01.800727 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Id: 9531d18446eb4488bbd1511cb3412925 Jun 30 18:47:01.800727 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Name: tempest-AttachVolumeNegativeTest-1944998081-project Jun 30 18:47:01.800727 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: method: > Jun 30 18:47:01.800727 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: exception: Instance ee34e802-b1fb-4445-a92f-8860154b9e2d could not be found. Jun 30 18:47:01.800727 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: action_args: {'id': 'ee34e802-b1fb-4445-a92f-8860154b9e2d'} Jun 30 18:47:01.801760 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:47:01.801760 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:47:01.801760 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:47:01.801760 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:47:01.801760 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:47:01.801760 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:47:01.801760 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:47:01.801760 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:47:01.801760 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:47:01.801760 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:47:01.801760 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee34e802-b1fb-4445-a92f-8860154b9e2d could not be found. Jun 30 18:47:01.801760 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:47:01.801760 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:47:01.801760 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:47:01.801760 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:47:01.801760 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:47:01.801760 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:47:01.801760 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:47:01.801760 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:47:01.801760 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:47:01.803368 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:47:01.803368 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 18:47:01.803368 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 18:47:01.803368 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 18:47:01.803368 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 18:47:01.803368 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:47:01.803368 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:47:01.803368 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:47:01.803368 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:47:01.803368 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee34e802-b1fb-4445-a92f-8860154b9e2d could not be found. Jun 30 18:47:01.803368 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:47:01.803368 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:47:01.803368 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:47:01.803368 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:47:01.803368 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:47:01.803368 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:47:01.803368 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:47:01.803368 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:47:01.803368 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee34e802-b1fb-4445-a92f-8860154b9e2d could not be found. Jun 30 18:47:01.803368 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:47:01.805026 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-21f9a583-381e-417b-a123-ee974cd3df85 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Returning 404 to user: Instance ee34e802-b1fb-4445-a92f-8860154b9e2d could not be found. {{(pid=117941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:47:01.805026 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-21f9a583-381e-417b-a123-ee974cd3df85 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d" status: 404 len: 111 microversion: 2.1 time: 0.031470 Jun 30 18:47:01.805026 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 650/1291] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 30 18:47:01 2022] DELETE /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:47:01.808819 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-4435f3cb-7f80-46ca-beb5-8f04916c2bea tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:47:01.809438 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-4435f3cb-7f80-46ca-beb5-8f04916c2bea tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: ee34e802-b1fb-4445-a92f-8860154b9e2d] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:47:01.815835 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-4435f3cb-7f80-46ca-beb5-8f04916c2bea tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:47:01.816284 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-4435f3cb-7f80-46ca-beb5-8f04916c2bea tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:47:01.817035 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-4435f3cb-7f80-46ca-beb5-8f04916c2bea tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:47:01.817469 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-4435f3cb-7f80-46ca-beb5-8f04916c2bea tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:47:01.830944 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.wsgi [None req-4435f3cb-7f80-46ca-beb5-8f04916c2bea tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] HTTP exception thrown: Instance ee34e802-b1fb-4445-a92f-8860154b9e2d could not be found. Jun 30 18:47:01.832454 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-4435f3cb-7f80-46ca-beb5-8f04916c2bea tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Request method failure captured: Jun 30 18:47:01.832454 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: request: GET /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d HTTP/1.1 Jun 30 18:47:01.832454 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept: application/json Jun 30 18:47:01.832454 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept-Encoding: identity Jun 30 18:47:01.832454 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Connection: close Jun 30 18:47:01.832454 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Length: 0 Jun 30 18:47:01.832454 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Type: application/json Jun 30 18:47:01.832454 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Host: 10.222.0.33 Jun 30 18:47:01.832454 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Openstack-System-Scope: None Jun 30 18:47:01.832454 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: User-Agent: python-urllib3/1.26.9 Jun 30 18:47:01.832454 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Auth-Token: gAAAAABive3_mQ4kZ2JNveNggCM2j6Qam1PzZzze4niNBx_ABO6k3xVntyI41bCtbU1dqHi3AaxJKokcovO0E907Am7gbM4_Spd2N8jkkVzqboNWXgAyxs4i5CVIc1cpe4RDkM3IBciZBWXtbJ1cU6IuTIKWreKtjsnNHJNRFm0dFUHScNhmgkQ Jun 30 18:47:01.832454 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Id: None Jun 30 18:47:01.832454 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Name: None Jun 30 18:47:01.832454 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Identity-Status: Confirmed Jun 30 18:47:01.832454 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Is-Admin-Project: True Jun 30 18:47:01.832454 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Id: default Jun 30 18:47:01.832454 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Name: Default Jun 30 18:47:01.832454 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Id: b8227be3d9a044ed888b2f54abd9463d Jun 30 18:47:01.832454 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Name: tempest-AttachVolumeNegativeTest-1944998081 Jun 30 18:47:01.832454 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Role: reader,member Jun 30 18:47:01.832454 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Roles: reader,member Jun 30 18:47:01.834231 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b8227be3d9a044ed888b2f54abd9463d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b8227be3d9a044ed888b2f54abd9463d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b8227be3d9a044ed888b2f54abd9463d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b8227be3d9a044ed888b2f54abd9463d"}]}] Jun 30 18:47:01.834231 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant: tempest-AttachVolumeNegativeTest-1944998081 Jun 30 18:47:01.834231 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Id: b8227be3d9a044ed888b2f54abd9463d Jun 30 18:47:01.834231 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1944998081 Jun 30 18:47:01.834231 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User: tempest-AttachVolumeNegativeTest-1944998081-project Jun 30 18:47:01.834231 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Id: default Jun 30 18:47:01.834231 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Name: Default Jun 30 18:47:01.834231 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Id: 9531d18446eb4488bbd1511cb3412925 Jun 30 18:47:01.834231 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Name: tempest-AttachVolumeNegativeTest-1944998081-project Jun 30 18:47:01.834231 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: method: > Jun 30 18:47:01.834231 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: exception: Instance ee34e802-b1fb-4445-a92f-8860154b9e2d could not be found. Jun 30 18:47:01.834231 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: action_args: {'id': 'ee34e802-b1fb-4445-a92f-8860154b9e2d'} Jun 30 18:47:01.835203 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:47:01.835203 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:47:01.835203 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:47:01.835203 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:47:01.835203 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:47:01.835203 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:47:01.835203 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:47:01.835203 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:47:01.835203 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:47:01.835203 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:47:01.835203 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee34e802-b1fb-4445-a92f-8860154b9e2d could not be found. Jun 30 18:47:01.835203 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:47:01.835203 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:47:01.835203 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:47:01.835203 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:47:01.835203 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:47:01.835203 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:47:01.835203 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:47:01.835203 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:47:01.835203 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:47:01.836835 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:47:01.836835 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:47:01.836835 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:47:01.836835 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:47:01.836835 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:47:01.836835 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:47:01.836835 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:47:01.836835 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee34e802-b1fb-4445-a92f-8860154b9e2d could not be found. Jun 30 18:47:01.836835 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:47:01.836835 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:47:01.836835 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:47:01.836835 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:47:01.836835 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:47:01.836835 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:47:01.836835 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:47:01.836835 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:47:01.836835 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee34e802-b1fb-4445-a92f-8860154b9e2d could not be found. Jun 30 18:47:01.836835 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:47:01.838302 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-4435f3cb-7f80-46ca-beb5-8f04916c2bea tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Returning 404 to user: Instance ee34e802-b1fb-4445-a92f-8860154b9e2d could not be found. {{(pid=117940) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:47:01.838302 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-4435f3cb-7f80-46ca-beb5-8f04916c2bea tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d" status: 404 len: 111 microversion: 2.1 time: 0.028960 Jun 30 18:47:01.838302 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 642/1292] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:47:01 2022] GET /compute/v2.1/servers/ee34e802-b1fb-4445-a92f-8860154b9e2d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:47:01.842856 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-a709c805-a192-436e-b0dc-364ce69f0cea tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:47:01.843351 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-a709c805-a192-436e-b0dc-364ce69f0cea tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 4281e4fd-b31a-4efd-9d86-15c070b7895e] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:47:01.849250 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a709c805-a192-436e-b0dc-364ce69f0cea tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:47:01.849731 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a709c805-a192-436e-b0dc-364ce69f0cea tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:47:01.850480 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a709c805-a192-436e-b0dc-364ce69f0cea tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:47:01.850905 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-a709c805-a192-436e-b0dc-364ce69f0cea tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:47:01.864119 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.wsgi [None req-a709c805-a192-436e-b0dc-364ce69f0cea tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] HTTP exception thrown: Instance 4281e4fd-b31a-4efd-9d86-15c070b7895e could not be found. Jun 30 18:47:01.865653 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-a709c805-a192-436e-b0dc-364ce69f0cea tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Request method failure captured: Jun 30 18:47:01.865653 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: request: DELETE /compute/v2.1/servers/4281e4fd-b31a-4efd-9d86-15c070b7895e HTTP/1.1 Jun 30 18:47:01.865653 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept: application/json Jun 30 18:47:01.865653 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept-Encoding: identity Jun 30 18:47:01.865653 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Connection: close Jun 30 18:47:01.865653 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Length: 0 Jun 30 18:47:01.865653 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Type: application/json Jun 30 18:47:01.865653 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Host: 10.222.0.33 Jun 30 18:47:01.865653 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Openstack-System-Scope: None Jun 30 18:47:01.865653 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: User-Agent: python-urllib3/1.26.9 Jun 30 18:47:01.865653 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Auth-Token: gAAAAABive3_mQ4kZ2JNveNggCM2j6Qam1PzZzze4niNBx_ABO6k3xVntyI41bCtbU1dqHi3AaxJKokcovO0E907Am7gbM4_Spd2N8jkkVzqboNWXgAyxs4i5CVIc1cpe4RDkM3IBciZBWXtbJ1cU6IuTIKWreKtjsnNHJNRFm0dFUHScNhmgkQ Jun 30 18:47:01.865653 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Id: None Jun 30 18:47:01.865653 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Name: None Jun 30 18:47:01.865653 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Identity-Status: Confirmed Jun 30 18:47:01.865653 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Is-Admin-Project: True Jun 30 18:47:01.865653 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Id: default Jun 30 18:47:01.865653 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Name: Default Jun 30 18:47:01.865653 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Id: b8227be3d9a044ed888b2f54abd9463d Jun 30 18:47:01.865653 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Name: tempest-AttachVolumeNegativeTest-1944998081 Jun 30 18:47:01.865653 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Role: reader,member Jun 30 18:47:01.865653 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Roles: reader,member Jun 30 18:47:01.867368 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b8227be3d9a044ed888b2f54abd9463d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b8227be3d9a044ed888b2f54abd9463d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b8227be3d9a044ed888b2f54abd9463d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b8227be3d9a044ed888b2f54abd9463d"}]}] Jun 30 18:47:01.867368 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant: tempest-AttachVolumeNegativeTest-1944998081 Jun 30 18:47:01.867368 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Id: b8227be3d9a044ed888b2f54abd9463d Jun 30 18:47:01.867368 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1944998081 Jun 30 18:47:01.867368 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User: tempest-AttachVolumeNegativeTest-1944998081-project Jun 30 18:47:01.867368 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Id: default Jun 30 18:47:01.867368 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Name: Default Jun 30 18:47:01.867368 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Id: 9531d18446eb4488bbd1511cb3412925 Jun 30 18:47:01.867368 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Name: tempest-AttachVolumeNegativeTest-1944998081-project Jun 30 18:47:01.867368 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: method: > Jun 30 18:47:01.867368 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: exception: Instance 4281e4fd-b31a-4efd-9d86-15c070b7895e could not be found. Jun 30 18:47:01.867368 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: action_args: {'id': '4281e4fd-b31a-4efd-9d86-15c070b7895e'} Jun 30 18:47:01.868462 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:47:01.868462 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:47:01.868462 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:47:01.868462 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:47:01.868462 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:47:01.868462 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:47:01.868462 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:47:01.868462 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:47:01.868462 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:47:01.868462 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:47:01.868462 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4281e4fd-b31a-4efd-9d86-15c070b7895e could not be found. Jun 30 18:47:01.868462 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:47:01.868462 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:47:01.868462 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:47:01.868462 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:47:01.868462 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:47:01.868462 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:47:01.868462 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:47:01.868462 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:47:01.868462 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:47:01.870325 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:47:01.870325 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 18:47:01.870325 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 18:47:01.870325 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 18:47:01.870325 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 18:47:01.870325 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:47:01.870325 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:47:01.870325 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:47:01.870325 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:47:01.870325 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4281e4fd-b31a-4efd-9d86-15c070b7895e could not be found. Jun 30 18:47:01.870325 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:47:01.870325 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:47:01.870325 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:47:01.870325 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:47:01.870325 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:47:01.870325 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:47:01.870325 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:47:01.870325 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:47:01.870325 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4281e4fd-b31a-4efd-9d86-15c070b7895e could not be found. Jun 30 18:47:01.870325 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:47:01.872033 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-a709c805-a192-436e-b0dc-364ce69f0cea tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Returning 404 to user: Instance 4281e4fd-b31a-4efd-9d86-15c070b7895e could not be found. {{(pid=117941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:47:01.872033 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-a709c805-a192-436e-b0dc-364ce69f0cea tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4281e4fd-b31a-4efd-9d86-15c070b7895e" status: 404 len: 111 microversion: 2.1 time: 0.028703 Jun 30 18:47:01.872033 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 651/1293] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 30 18:47:01 2022] DELETE /compute/v2.1/servers/4281e4fd-b31a-4efd-9d86-15c070b7895e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:47:01.875752 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-0fd85907-27f8-4654-a37f-b1fbf941b6f8 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:47:01.876366 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-0fd85907-27f8-4654-a37f-b1fbf941b6f8 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: 4281e4fd-b31a-4efd-9d86-15c070b7895e] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:47:01.883213 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0fd85907-27f8-4654-a37f-b1fbf941b6f8 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:47:01.883664 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0fd85907-27f8-4654-a37f-b1fbf941b6f8 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:47:01.884558 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0fd85907-27f8-4654-a37f-b1fbf941b6f8 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:47:01.884985 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-0fd85907-27f8-4654-a37f-b1fbf941b6f8 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:47:01.901207 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.wsgi [None req-0fd85907-27f8-4654-a37f-b1fbf941b6f8 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] HTTP exception thrown: Instance 4281e4fd-b31a-4efd-9d86-15c070b7895e could not be found. Jun 30 18:47:01.903322 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-0fd85907-27f8-4654-a37f-b1fbf941b6f8 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Request method failure captured: Jun 30 18:47:01.903322 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: request: GET /compute/v2.1/servers/4281e4fd-b31a-4efd-9d86-15c070b7895e HTTP/1.1 Jun 30 18:47:01.903322 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept: application/json Jun 30 18:47:01.903322 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept-Encoding: identity Jun 30 18:47:01.903322 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Connection: close Jun 30 18:47:01.903322 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Length: 0 Jun 30 18:47:01.903322 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Type: application/json Jun 30 18:47:01.903322 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Host: 10.222.0.33 Jun 30 18:47:01.903322 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Openstack-System-Scope: None Jun 30 18:47:01.903322 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: User-Agent: python-urllib3/1.26.9 Jun 30 18:47:01.903322 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Auth-Token: gAAAAABive3_mQ4kZ2JNveNggCM2j6Qam1PzZzze4niNBx_ABO6k3xVntyI41bCtbU1dqHi3AaxJKokcovO0E907Am7gbM4_Spd2N8jkkVzqboNWXgAyxs4i5CVIc1cpe4RDkM3IBciZBWXtbJ1cU6IuTIKWreKtjsnNHJNRFm0dFUHScNhmgkQ Jun 30 18:47:01.903322 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Id: None Jun 30 18:47:01.903322 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Name: None Jun 30 18:47:01.903322 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Identity-Status: Confirmed Jun 30 18:47:01.903322 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Is-Admin-Project: True Jun 30 18:47:01.903322 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Id: default Jun 30 18:47:01.903322 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Name: Default Jun 30 18:47:01.903322 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Id: b8227be3d9a044ed888b2f54abd9463d Jun 30 18:47:01.903322 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Name: tempest-AttachVolumeNegativeTest-1944998081 Jun 30 18:47:01.903322 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Role: reader,member Jun 30 18:47:01.903322 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Roles: reader,member Jun 30 18:47:01.905120 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b8227be3d9a044ed888b2f54abd9463d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b8227be3d9a044ed888b2f54abd9463d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b8227be3d9a044ed888b2f54abd9463d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b8227be3d9a044ed888b2f54abd9463d"}]}] Jun 30 18:47:01.905120 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant: tempest-AttachVolumeNegativeTest-1944998081 Jun 30 18:47:01.905120 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Id: b8227be3d9a044ed888b2f54abd9463d Jun 30 18:47:01.905120 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1944998081 Jun 30 18:47:01.905120 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User: tempest-AttachVolumeNegativeTest-1944998081-project Jun 30 18:47:01.905120 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Id: default Jun 30 18:47:01.905120 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Name: Default Jun 30 18:47:01.905120 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Id: 9531d18446eb4488bbd1511cb3412925 Jun 30 18:47:01.905120 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Name: tempest-AttachVolumeNegativeTest-1944998081-project Jun 30 18:47:01.905120 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: method: > Jun 30 18:47:01.905120 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: exception: Instance 4281e4fd-b31a-4efd-9d86-15c070b7895e could not be found. Jun 30 18:47:01.905120 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: action_args: {'id': '4281e4fd-b31a-4efd-9d86-15c070b7895e'} Jun 30 18:47:01.906179 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:47:01.906179 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:47:01.906179 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:47:01.906179 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:47:01.906179 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:47:01.906179 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:47:01.906179 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:47:01.906179 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:47:01.906179 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:47:01.906179 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:47:01.906179 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4281e4fd-b31a-4efd-9d86-15c070b7895e could not be found. Jun 30 18:47:01.906179 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:47:01.906179 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:47:01.906179 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:47:01.906179 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:47:01.906179 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:47:01.906179 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:47:01.906179 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:47:01.906179 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:47:01.906179 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:47:01.907871 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:47:01.907871 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:47:01.907871 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:47:01.907871 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:47:01.907871 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:47:01.907871 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:47:01.907871 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:47:01.907871 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4281e4fd-b31a-4efd-9d86-15c070b7895e could not be found. Jun 30 18:47:01.907871 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:47:01.907871 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:47:01.907871 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:47:01.907871 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:47:01.907871 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:47:01.907871 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:47:01.907871 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:47:01.907871 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:47:01.907871 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4281e4fd-b31a-4efd-9d86-15c070b7895e could not be found. Jun 30 18:47:01.907871 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:47:01.909329 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-0fd85907-27f8-4654-a37f-b1fbf941b6f8 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Returning 404 to user: Instance 4281e4fd-b31a-4efd-9d86-15c070b7895e could not be found. {{(pid=117940) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:47:01.909329 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-0fd85907-27f8-4654-a37f-b1fbf941b6f8 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/4281e4fd-b31a-4efd-9d86-15c070b7895e" status: 404 len: 111 microversion: 2.1 time: 0.032775 Jun 30 18:47:01.909329 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 643/1294] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:47:01 2022] GET /compute/v2.1/servers/4281e4fd-b31a-4efd-9d86-15c070b7895e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:47:03.038634 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-aea869e9-2679-47da-9ca5-35b2c053f2c0 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:47:03.039147 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-aea869e9-2679-47da-9ca5-35b2c053f2c0 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: f83962b1-e24e-41ad-969a-b5d8bc609f2c] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:47:03.046378 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-aea869e9-2679-47da-9ca5-35b2c053f2c0 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:47:03.046814 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-aea869e9-2679-47da-9ca5-35b2c053f2c0 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:47:03.047558 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-aea869e9-2679-47da-9ca5-35b2c053f2c0 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:47:03.047982 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-aea869e9-2679-47da-9ca5-35b2c053f2c0 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:47:03.061050 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.wsgi [None req-aea869e9-2679-47da-9ca5-35b2c053f2c0 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] HTTP exception thrown: Instance f83962b1-e24e-41ad-969a-b5d8bc609f2c could not be found. Jun 30 18:47:03.062623 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-aea869e9-2679-47da-9ca5-35b2c053f2c0 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Request method failure captured: Jun 30 18:47:03.062623 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: request: DELETE /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c HTTP/1.1 Jun 30 18:47:03.062623 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept: application/json Jun 30 18:47:03.062623 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Accept-Encoding: identity Jun 30 18:47:03.062623 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Connection: close Jun 30 18:47:03.062623 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Length: 0 Jun 30 18:47:03.062623 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Content-Type: application/json Jun 30 18:47:03.062623 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Host: 10.222.0.33 Jun 30 18:47:03.062623 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Openstack-System-Scope: None Jun 30 18:47:03.062623 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: User-Agent: python-urllib3/1.26.9 Jun 30 18:47:03.062623 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Auth-Token: gAAAAABive3_mQ4kZ2JNveNggCM2j6Qam1PzZzze4niNBx_ABO6k3xVntyI41bCtbU1dqHi3AaxJKokcovO0E907Am7gbM4_Spd2N8jkkVzqboNWXgAyxs4i5CVIc1cpe4RDkM3IBciZBWXtbJ1cU6IuTIKWreKtjsnNHJNRFm0dFUHScNhmgkQ Jun 30 18:47:03.062623 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Id: None Jun 30 18:47:03.062623 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Domain-Name: None Jun 30 18:47:03.062623 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Identity-Status: Confirmed Jun 30 18:47:03.062623 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Is-Admin-Project: True Jun 30 18:47:03.062623 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Id: default Jun 30 18:47:03.062623 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Domain-Name: Default Jun 30 18:47:03.062623 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Id: b8227be3d9a044ed888b2f54abd9463d Jun 30 18:47:03.062623 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Project-Name: tempest-AttachVolumeNegativeTest-1944998081 Jun 30 18:47:03.062623 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Role: reader,member Jun 30 18:47:03.062623 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Roles: reader,member Jun 30 18:47:03.064386 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b8227be3d9a044ed888b2f54abd9463d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b8227be3d9a044ed888b2f54abd9463d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b8227be3d9a044ed888b2f54abd9463d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b8227be3d9a044ed888b2f54abd9463d"}]}] Jun 30 18:47:03.064386 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant: tempest-AttachVolumeNegativeTest-1944998081 Jun 30 18:47:03.064386 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Id: b8227be3d9a044ed888b2f54abd9463d Jun 30 18:47:03.064386 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1944998081 Jun 30 18:47:03.064386 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User: tempest-AttachVolumeNegativeTest-1944998081-project Jun 30 18:47:03.064386 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Id: default Jun 30 18:47:03.064386 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Domain-Name: Default Jun 30 18:47:03.064386 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Id: 9531d18446eb4488bbd1511cb3412925 Jun 30 18:47:03.064386 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: X-User-Name: tempest-AttachVolumeNegativeTest-1944998081-project Jun 30 18:47:03.064386 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: method: > Jun 30 18:47:03.064386 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: exception: Instance f83962b1-e24e-41ad-969a-b5d8bc609f2c could not be found. Jun 30 18:47:03.064386 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: action_args: {'id': 'f83962b1-e24e-41ad-969a-b5d8bc609f2c'} Jun 30 18:47:03.065367 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:47:03.065367 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:47:03.065367 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:47:03.065367 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:47:03.065367 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:47:03.065367 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:47:03.065367 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:47:03.065367 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:47:03.065367 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:47:03.065367 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:47:03.065367 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f83962b1-e24e-41ad-969a-b5d8bc609f2c could not be found. Jun 30 18:47:03.065367 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:47:03.065367 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:47:03.065367 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:47:03.065367 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:47:03.065367 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:47:03.065367 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:47:03.065367 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:47:03.065367 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:47:03.065367 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:47:03.067085 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:47:03.067085 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 18:47:03.067085 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 18:47:03.067085 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 18:47:03.067085 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 18:47:03.067085 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:47:03.067085 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:47:03.067085 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:47:03.067085 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:47:03.067085 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f83962b1-e24e-41ad-969a-b5d8bc609f2c could not be found. Jun 30 18:47:03.067085 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:47:03.067085 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:47:03.067085 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:47:03.067085 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:47:03.067085 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:47:03.067085 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:47:03.067085 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:47:03.067085 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:47:03.067085 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f83962b1-e24e-41ad-969a-b5d8bc609f2c could not be found. Jun 30 18:47:03.067085 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: ERROR nova.api.openstack.wsgi Jun 30 18:47:03.069012 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-aea869e9-2679-47da-9ca5-35b2c053f2c0 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Returning 404 to user: Instance f83962b1-e24e-41ad-969a-b5d8bc609f2c could not be found. {{(pid=117941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:47:03.069012 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-aea869e9-2679-47da-9ca5-35b2c053f2c0 tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c" status: 404 len: 111 microversion: 2.1 time: 0.029266 Jun 30 18:47:03.069012 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 652/1295] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 30 18:47:03 2022] DELETE /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:47:03.072260 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-cbcfa5bc-75e6-4311-8b12-150fa1b6f3dd tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:47:03.072863 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-cbcfa5bc-75e6-4311-8b12-150fa1b6f3dd tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] [instance: f83962b1-e24e-41ad-969a-b5d8bc609f2c] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:47:03.079295 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cbcfa5bc-75e6-4311-8b12-150fa1b6f3dd tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:47:03.079736 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cbcfa5bc-75e6-4311-8b12-150fa1b6f3dd tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:47:03.080477 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cbcfa5bc-75e6-4311-8b12-150fa1b6f3dd tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:47:03.080902 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-cbcfa5bc-75e6-4311-8b12-150fa1b6f3dd tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:47:03.094421 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.wsgi [None req-cbcfa5bc-75e6-4311-8b12-150fa1b6f3dd tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] HTTP exception thrown: Instance f83962b1-e24e-41ad-969a-b5d8bc609f2c could not be found. Jun 30 18:47:03.095948 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-cbcfa5bc-75e6-4311-8b12-150fa1b6f3dd tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Request method failure captured: Jun 30 18:47:03.095948 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: request: GET /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c HTTP/1.1 Jun 30 18:47:03.095948 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept: application/json Jun 30 18:47:03.095948 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept-Encoding: identity Jun 30 18:47:03.095948 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Connection: close Jun 30 18:47:03.095948 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Length: 0 Jun 30 18:47:03.095948 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Type: application/json Jun 30 18:47:03.095948 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Host: 10.222.0.33 Jun 30 18:47:03.095948 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Openstack-System-Scope: None Jun 30 18:47:03.095948 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: User-Agent: python-urllib3/1.26.9 Jun 30 18:47:03.095948 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Auth-Token: gAAAAABive3_mQ4kZ2JNveNggCM2j6Qam1PzZzze4niNBx_ABO6k3xVntyI41bCtbU1dqHi3AaxJKokcovO0E907Am7gbM4_Spd2N8jkkVzqboNWXgAyxs4i5CVIc1cpe4RDkM3IBciZBWXtbJ1cU6IuTIKWreKtjsnNHJNRFm0dFUHScNhmgkQ Jun 30 18:47:03.095948 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Id: None Jun 30 18:47:03.095948 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Name: None Jun 30 18:47:03.095948 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Identity-Status: Confirmed Jun 30 18:47:03.095948 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Is-Admin-Project: True Jun 30 18:47:03.095948 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Id: default Jun 30 18:47:03.095948 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Name: Default Jun 30 18:47:03.095948 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Id: b8227be3d9a044ed888b2f54abd9463d Jun 30 18:47:03.095948 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Name: tempest-AttachVolumeNegativeTest-1944998081 Jun 30 18:47:03.095948 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Role: reader,member Jun 30 18:47:03.095948 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Roles: reader,member Jun 30 18:47:03.097908 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b8227be3d9a044ed888b2f54abd9463d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b8227be3d9a044ed888b2f54abd9463d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b8227be3d9a044ed888b2f54abd9463d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b8227be3d9a044ed888b2f54abd9463d"}]}] Jun 30 18:47:03.097908 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant: tempest-AttachVolumeNegativeTest-1944998081 Jun 30 18:47:03.097908 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Id: b8227be3d9a044ed888b2f54abd9463d Jun 30 18:47:03.097908 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1944998081 Jun 30 18:47:03.097908 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User: tempest-AttachVolumeNegativeTest-1944998081-project Jun 30 18:47:03.097908 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Id: default Jun 30 18:47:03.097908 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Name: Default Jun 30 18:47:03.097908 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Id: 9531d18446eb4488bbd1511cb3412925 Jun 30 18:47:03.097908 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Name: tempest-AttachVolumeNegativeTest-1944998081-project Jun 30 18:47:03.097908 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: method: > Jun 30 18:47:03.097908 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: exception: Instance f83962b1-e24e-41ad-969a-b5d8bc609f2c could not be found. Jun 30 18:47:03.097908 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: action_args: {'id': 'f83962b1-e24e-41ad-969a-b5d8bc609f2c'} Jun 30 18:47:03.098896 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:47:03.098896 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:47:03.098896 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:47:03.098896 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:47:03.098896 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:47:03.098896 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:47:03.098896 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:47:03.098896 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:47:03.098896 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:47:03.098896 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:47:03.098896 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f83962b1-e24e-41ad-969a-b5d8bc609f2c could not be found. Jun 30 18:47:03.098896 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:47:03.098896 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:47:03.098896 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:47:03.098896 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:47:03.098896 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:47:03.098896 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:47:03.098896 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:47:03.098896 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:47:03.098896 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:47:03.100529 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:47:03.100529 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:47:03.100529 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:47:03.100529 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:47:03.100529 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:47:03.100529 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:47:03.100529 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:47:03.100529 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f83962b1-e24e-41ad-969a-b5d8bc609f2c could not be found. Jun 30 18:47:03.100529 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:47:03.100529 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:47:03.100529 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:47:03.100529 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:47:03.100529 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:47:03.100529 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:47:03.100529 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:47:03.100529 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:47:03.100529 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f83962b1-e24e-41ad-969a-b5d8bc609f2c could not be found. Jun 30 18:47:03.100529 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:47:03.102340 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-cbcfa5bc-75e6-4311-8b12-150fa1b6f3dd tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] Returning 404 to user: Instance f83962b1-e24e-41ad-969a-b5d8bc609f2c could not be found. {{(pid=117940) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:47:03.102340 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-cbcfa5bc-75e6-4311-8b12-150fa1b6f3dd tempest-AttachVolumeNegativeTest-1944998081 tempest-AttachVolumeNegativeTest-1944998081-project] 10.222.0.33 "GET /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c" status: 404 len: 111 microversion: 2.1 time: 0.028693 Jun 30 18:47:03.102340 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 644/1296] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:47:03 2022] GET /compute/v2.1/servers/f83962b1-e24e-41ad-969a-b5d8bc609f2c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:47:09.173084 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [req-9a15218c-c1d3-4614-995e-009c36ab77c5 req-8918ac92-4200-48ff-8274-e7b981606a58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e521acf7-4c22-4f2f-9014-0fe2b98e5177", "tag": "2f35c8e5-f600-4e52-a4cb-3e624aeebaff"}]} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:47:09.183875 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-9a15218c-c1d3-4614-995e-009c36ab77c5 req-8918ac92-4200-48ff-8274-e7b981606a58 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:47:09.184671 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-9a15218c-c1d3-4614-995e-009c36ab77c5 req-8918ac92-4200-48ff-8274-e7b981606a58 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:47:09.202477 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.compute.server_external_events [req-9a15218c-c1d3-4614-995e-009c36ab77c5 req-8918ac92-4200-48ff-8274-e7b981606a58 service nova] Creating event network-changed:2f35c8e5-f600-4e52-a4cb-3e624aeebaff for instance e521acf7-4c22-4f2f-9014-0fe2b98e5177 on hv-cinder-80378 Jun 30 18:47:09.213209 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [req-9a15218c-c1d3-4614-995e-009c36ab77c5 req-8918ac92-4200-48ff-8274-e7b981606a58 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193702 Jun 30 18:47:09.228609 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 645/1297] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:47:09.348882 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-aebde582-0250-4f37-ac51-2ef761409270 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:47:09.350117 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-aebde582-0250-4f37-ac51-2ef761409270 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:47:09.357759 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-aebde582-0250-4f37-ac51-2ef761409270 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:47:09.358512 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-aebde582-0250-4f37-ac51-2ef761409270 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:47:09.360277 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-aebde582-0250-4f37-ac51-2ef761409270 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:47:09.360923 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-aebde582-0250-4f37-ac51-2ef761409270 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:47:09.389215 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-aebde582-0250-4f37-ac51-2ef761409270 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Going to try to terminate instance {{(pid=117941) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 18:47:09.511837 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-aebde582-0250-4f37-ac51-2ef761409270 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177" status: 204 len: 0 microversion: 2.1 time: 0.495256 Jun 30 18:47:09.514379 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 653/1298] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 30 18:47:09 2022] DELETE /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 18:47:09.523689 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-b2d93714-35b5-437a-888a-12d5db4e764a tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:47:09.524757 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-b2d93714-35b5-437a-888a-12d5db4e764a tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:47:09.544390 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b2d93714-35b5-437a-888a-12d5db4e764a tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:47:09.545127 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b2d93714-35b5-437a-888a-12d5db4e764a tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:47:09.546175 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b2d93714-35b5-437a-888a-12d5db4e764a tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:47:09.548916 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-b2d93714-35b5-437a-888a-12d5db4e764a tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:47:09.720007 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.policy [None req-b2d93714-35b5-437a-888a-12d5db4e764a tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f4e45a0882410088464b550a4b06c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc355242c9d490d91fbcbd7d08f8b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117940) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:47:09.733188 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-b2d93714-35b5-437a-888a-12d5db4e764a tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177" status: 200 len: 1568 microversion: 2.1 time: 0.215057 Jun 30 18:47:09.734295 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 646/1299] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:47:09 2022] GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177 => generated 1568 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:47:10.753252 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-3a66d257-0eb0-4fb2-b01f-895dc7986296 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:47:10.753963 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-3a66d257-0eb0-4fb2-b01f-895dc7986296 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:47:10.760284 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3a66d257-0eb0-4fb2-b01f-895dc7986296 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:47:10.760720 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3a66d257-0eb0-4fb2-b01f-895dc7986296 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:47:10.761892 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3a66d257-0eb0-4fb2-b01f-895dc7986296 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:47:10.762155 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-3a66d257-0eb0-4fb2-b01f-895dc7986296 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:47:11.059098 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-3a66d257-0eb0-4fb2-b01f-895dc7986296 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f4e45a0882410088464b550a4b06c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc355242c9d490d91fbcbd7d08f8b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:47:11.066941 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-3a66d257-0eb0-4fb2-b01f-895dc7986296 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177" status: 200 len: 1568 microversion: 2.1 time: 0.317889 Jun 30 18:47:11.067763 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 654/1300] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:47:10 2022] GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177 => generated 1568 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:47:11.884731 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [req-400f47dd-787a-4ef3-b960-a4df50d6afe1 req-7ea82f76-e75e-4214-8106-4a86a0b98c59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e521acf7-4c22-4f2f-9014-0fe2b98e5177", "name": "network-vif-deleted", "tag": "2f35c8e5-f600-4e52-a4cb-3e624aeebaff"}]} {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:47:11.901634 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-400f47dd-787a-4ef3-b960-a4df50d6afe1 req-7ea82f76-e75e-4214-8106-4a86a0b98c59 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:47:11.902091 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [req-400f47dd-787a-4ef3-b960-a4df50d6afe1 req-7ea82f76-e75e-4214-8106-4a86a0b98c59 service nova] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:47:11.913936 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.compute.server_external_events [req-400f47dd-787a-4ef3-b960-a4df50d6afe1 req-7ea82f76-e75e-4214-8106-4a86a0b98c59 service nova] Creating event network-vif-deleted:2f35c8e5-f600-4e52-a4cb-3e624aeebaff for instance e521acf7-4c22-4f2f-9014-0fe2b98e5177 on hv-cinder-80378 Jun 30 18:47:11.919813 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [req-400f47dd-787a-4ef3-b960-a4df50d6afe1 req-7ea82f76-e75e-4214-8106-4a86a0b98c59 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038710 Jun 30 18:47:11.924485 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 647/1301] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 30 18:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:47:12.084321 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-ece8982d-dd7d-4032-8c75-b90d5f1595df tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Calling method '>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:47:12.084933 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.compute.api [None req-ece8982d-dd7d-4032-8c75-b90d5f1595df tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Fetching instance by UUID {{(pid=117941) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:47:12.092448 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ece8982d-dd7d-4032-8c75-b90d5f1595df tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:47:12.093072 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ece8982d-dd7d-4032-8c75-b90d5f1595df tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:47:12.093967 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ece8982d-dd7d-4032-8c75-b90d5f1595df tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:47:12.094382 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG oslo_concurrency.lockutils [None req-ece8982d-dd7d-4032-8c75-b90d5f1595df tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:47:12.169023 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.policy [None req-ece8982d-dd7d-4032-8c75-b90d5f1595df tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f4e45a0882410088464b550a4b06c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc355242c9d490d91fbcbd7d08f8b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117941) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:47:12.176796 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-ece8982d-dd7d-4032-8c75-b90d5f1595df tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177" status: 200 len: 1220 microversion: 2.1 time: 0.096236 Jun 30 18:47:12.177363 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 655/1302] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:47:12 2022] GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177 => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:47:13.195330 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-4e50da30-9ece-4678-8847-9665c79df51b tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Calling method '>' {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:47:13.196034 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.compute.api [None req-4e50da30-9ece-4678-8847-9665c79df51b tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] [instance: e521acf7-4c22-4f2f-9014-0fe2b98e5177] Fetching instance by UUID {{(pid=117940) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:47:13.203431 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-4e50da30-9ece-4678-8847-9665c79df51b tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:47:13.203882 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-4e50da30-9ece-4678-8847-9665c79df51b tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:47:13.205255 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-4e50da30-9ece-4678-8847-9665c79df51b tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:47:13.205714 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG oslo_concurrency.lockutils [None req-4e50da30-9ece-4678-8847-9665c79df51b tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Lock "91ffa63e-ed46-4e0d-b7bb-17bc9fc6235c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:47:13.220523 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.wsgi [None req-4e50da30-9ece-4678-8847-9665c79df51b tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] HTTP exception thrown: Instance e521acf7-4c22-4f2f-9014-0fe2b98e5177 could not be found. Jun 30 18:47:13.222212 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-4e50da30-9ece-4678-8847-9665c79df51b tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Request method failure captured: Jun 30 18:47:13.222212 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: request: GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177 HTTP/1.1 Jun 30 18:47:13.222212 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept: application/json Jun 30 18:47:13.222212 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Accept-Encoding: identity Jun 30 18:47:13.222212 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Connection: close Jun 30 18:47:13.222212 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Length: 0 Jun 30 18:47:13.222212 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Content-Type: application/json Jun 30 18:47:13.222212 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Host: 10.222.0.33 Jun 30 18:47:13.222212 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Openstack-System-Scope: None Jun 30 18:47:13.222212 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: User-Agent: python-urllib3/1.26.9 Jun 30 18:47:13.222212 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Auth-Token: gAAAAABive58flyMDszHfv8mqlT8kFEHJGSJ-JXZrNWE8owi21smNNPitkxjuX0ZZ0rUV9wNim38UxikvL_1wjEdpSz8fEPZUgQFtRdcFtMc3_DqbGLfzS_7aqDqKrbAQEufOU7KhFKLNIYuOchuLVvkb7bae9gY6k7bD7sUS04wvrmI4quZqfQ Jun 30 18:47:13.222212 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Id: None Jun 30 18:47:13.222212 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Domain-Name: None Jun 30 18:47:13.222212 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Identity-Status: Confirmed Jun 30 18:47:13.222212 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Is-Admin-Project: True Jun 30 18:47:13.222212 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Id: default Jun 30 18:47:13.222212 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Domain-Name: Default Jun 30 18:47:13.222212 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Id: 8bc355242c9d490d91fbcbd7d08f8b97 Jun 30 18:47:13.222212 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Project-Name: tempest-TestShelveInstance-2065540748 Jun 30 18:47:13.222212 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Role: reader,member Jun 30 18:47:13.222212 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Roles: reader,member Jun 30 18:47:13.224017 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8bc355242c9d490d91fbcbd7d08f8b97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8bc355242c9d490d91fbcbd7d08f8b97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8bc355242c9d490d91fbcbd7d08f8b97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8bc355242c9d490d91fbcbd7d08f8b97"}]}] Jun 30 18:47:13.224017 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant: tempest-TestShelveInstance-2065540748 Jun 30 18:47:13.224017 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Id: 8bc355242c9d490d91fbcbd7d08f8b97 Jun 30 18:47:13.224017 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-Tenant-Name: tempest-TestShelveInstance-2065540748 Jun 30 18:47:13.224017 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User: tempest-TestShelveInstance-2065540748-project Jun 30 18:47:13.224017 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Id: default Jun 30 18:47:13.224017 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Domain-Name: Default Jun 30 18:47:13.224017 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Id: f7f4e45a0882410088464b550a4b06c1 Jun 30 18:47:13.224017 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: X-User-Name: tempest-TestShelveInstance-2065540748-project Jun 30 18:47:13.224017 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: method: > Jun 30 18:47:13.224017 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: exception: Instance e521acf7-4c22-4f2f-9014-0fe2b98e5177 could not be found. Jun 30 18:47:13.224017 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: action_args: {'id': 'e521acf7-4c22-4f2f-9014-0fe2b98e5177'} Jun 30 18:47:13.225231 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: {{(pid=117940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:47:13.225231 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:47:13.225231 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:47:13.225231 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:47:13.225231 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:47:13.225231 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:47:13.225231 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:47:13.225231 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:47:13.225231 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:47:13.225231 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:47:13.225231 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e521acf7-4c22-4f2f-9014-0fe2b98e5177 could not be found. Jun 30 18:47:13.225231 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:47:13.225231 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:47:13.225231 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:47:13.225231 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:47:13.225231 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:47:13.225231 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:47:13.225231 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:47:13.225231 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:47:13.225231 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:47:13.227183 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:47:13.227183 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:47:13.227183 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:47:13.227183 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:47:13.227183 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:47:13.227183 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:47:13.227183 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:47:13.227183 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e521acf7-4c22-4f2f-9014-0fe2b98e5177 could not be found. Jun 30 18:47:13.227183 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:47:13.227183 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:47:13.227183 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:47:13.227183 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:47:13.227183 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:47:13.227183 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:47:13.227183 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:47:13.227183 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:47:13.227183 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e521acf7-4c22-4f2f-9014-0fe2b98e5177 could not be found. Jun 30 18:47:13.227183 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: ERROR nova.api.openstack.wsgi Jun 30 18:47:13.228848 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: DEBUG nova.api.openstack.wsgi [None req-4e50da30-9ece-4678-8847-9665c79df51b tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Returning 404 to user: Instance e521acf7-4c22-4f2f-9014-0fe2b98e5177 could not be found. {{(pid=117940) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:47:13.228848 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO nova.api.openstack.requestlog [None req-4e50da30-9ece-4678-8847-9665c79df51b tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177" status: 404 len: 111 microversion: 2.1 time: 0.032916 Jun 30 18:47:13.228848 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: [pid: 117940|app: 0|req: 648/1303] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 30 18:47:13 2022] GET /compute/v2.1/servers/e521acf7-4c22-4f2f-9014-0fe2b98e5177 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:47:13.397955 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: DEBUG nova.api.openstack.wsgi [None req-91dfcadb-1e26-4a25-860a-83e121139605 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] Calling method '.version_select at 0x7f1804e15b80>' {{(pid=117941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:47:13.420268 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO nova.api.openstack.requestlog [None req-91dfcadb-1e26-4a25-860a-83e121139605 tempest-TestShelveInstance-2065540748 tempest-TestShelveInstance-2065540748-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1513175658" status: 202 len: 0 microversion: 2.1 time: 0.026583 Jun 30 18:47:13.425512 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: [pid: 117941|app: 0|req: 656/1304] 10.222.0.33 () {58 vars in 1253 bytes} [Thu Jun 30 18:47:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1513175658 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 18:48:36.594257 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:48:36.594893 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Thu Jun 30 18:48:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:50:07.034053 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:50:07.035140 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Thu Jun 30 18:50:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:50:14.195917 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:50:14.196571 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Thu Jun 30 18:50:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:50:15.086618 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:50:15.086782 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Thu Jun 30 18:50:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:50:27.514632 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:50:27.515231 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Thu Jun 30 18:50:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:50:27.887120 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:50:27.887975 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Thu Jun 30 18:50:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:51:56.604406 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:51:56.605017 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Thu Jun 30 18:51:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:53:27.042598 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:53:27.043192 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Thu Jun 30 18:53:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:53:34.203704 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:53:34.204248 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Thu Jun 30 18:53:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:53:35.094313 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:53:35.094472 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Thu Jun 30 18:53:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:53:47.522991 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:53:47.523498 dv-cinder-803785-1-iscsi devstack@n-api.service[117940]: Thu Jun 30 18:53:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:53:47.895835 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:53:47.896292 dv-cinder-803785-1-iscsi devstack@n-api.service[117941]: Thu Jun 30 18:53:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!